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ABSTRACT 


Two  different  associative  memory  systems  implemented  by  cryotrons 
and  cutpoint  cells  arc  presented.  The  cutpoint  cellular  associative  memory 
designed  on  the  basis  of  stage  delay  analysis  does  not  use  any  ladder  struc¬ 
ture,  but  employs  a  high-speed  controlled  shift  register  for  the  sequential 
tagging  of  all  matched  memory  words.  Both  systems  are  so  mechanized  that 
their  structures  arc  simple  and  especially  compatible  with  the  batch  fab¬ 
rication  of  integrated  circuits.  Moreover,  both  systems  can  perform  or¬ 
dered  information  retrieval  following  Lewis's  sorting  scheme,  template¬ 
matching  pattern  recognition  based  on  the  union-intersection  concept  and 
nonbulk  two-summand  additions  of  signed  binary  numbers  in  the  signed-2's- 
complement  number  system.  The  basic  operations  of  each  system  include 
comparison,  reading,  writing,  sensing  and  output-summing  processes  being 
all  performed  on  the  basis  of  parallel-by-bit.  During  simultaneous  com¬ 
parison,  a  bit-position  corresponding  to  all  bit-memories  of  equal  signi¬ 
ficance  can  be  masked  out.  In  pattern  recognition,  each  pattern  class 
is  allowed  to  have  deviations  in  size,  style,  orientation,  etc.  within 
certain  limits.  Since  each  prestored  template  for  a  pattern  class  can 
accommodate  to  a  number  of  deviated  input  patterns  belonging  to  the  same 
class,  the  storage  capacity  can  be  greatly  saved.  Because  most  input 
patterns  are  recognized  within  first  processing  cycle  and  no  patterns 
require  more  than  two  comparison  processes  for  their  recognition,  the 
pattern  recognition  scheme  is  simple.  The  speed  is  very  high  because  of 
this  simple  scheme  as  well  as  the  parallel  processing  capability  of  an 
associative  memory.  The  processing  system  for  arithmetic  operations  con¬ 
sists  of  an  associative  memory,  right  shift  registers  and  Mealy  type  se¬ 
quential  machines.  This  system  may  have  the  advantage  of  reducing  addi¬ 
tion  time  by  paying  a  limited  price  in  the  additional  hardware  relative 
to  the  existing  software  approaches  for  arithmetic  algorithms. 


iii 


2.  A  CRYOGENIC  ASSOCIATIVE  MEMORY  SYSTEM 
2.1.  INTRODUCTION 

Among  the  existing  associative  memories,  more  than  half  of  them  has 
been  implemented  by  cryotrons  because  a  cryotron  circuit  is  able  to  in¬ 
tegrate  the  storage  and  logic  functions  together  so  that  the  structure 
of  circuitry  is  simple  and  the  internal  power  transfers  can  be  held  to 
a  minimum  degree.  Furthermore,  cryotrons  are  very  reliable  and  ex¬ 
tremely  small,  consume  little  power,  and  can  easily  be  used  with  other 
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circuit  elements  such  as  tunnel  diodes  [33]. 

The  principal  limitation  on  the  use  of  cryogenic  associative  memory 
systems  is  their  operating  speed,  which  is  usually  slower  than  those  im¬ 
plemented  by  other  circuit  elements,  such  as  magnetic  core;  and  cutpoint 
cells.  However,  this  can  be  improved  by  simplifying  the  system  organi¬ 
zation,  reducing  the  number  of  stage  delays  in  every  process,  and  develop¬ 
ing  better  batch-fabrication  techniques  in  manufacturing  the  cryogenic 
circuits  [34],  Another  disadvantage  of  a  cryogenic  system  arises  from 
the  fact  that  the  whole  cryogenic  circuit  can  operate  only  under  low 
temperature  (close  to  3.5°k)  and  hence  it  must  be  stored  in  a  liquid 
helium  regrigerator.  Since  the  cost  of  cryotron  circuits  is  relatively 
low  compared  with  other  circuit  elements,  the  expense  of  maintaining  a 
liquid  helium  refrigerator  may  be  absorbed  when  the  capacity  of  a  cryo¬ 
genic  associative  memory  system  is  large.  In  current  thinking,  it  is 
reasonably  expected  that  a  future  large- capacity  high-speed  associative 
memory  system  will  be  made  of  both  cryotrons  and  semiconductor  devices. 

Since  most  of  the  existing  cryogenic  associative  memory  systems 
possesses  the  weakness  of  low  operating  speed  and  limited  applications, 
the  purpose  of  this  chapter  is  to  introduce  the  logical  structure  of  a 
new  cryogenic  associative  memory  system  which  has  the  following  advantages 

1) .  In  ordered  information  retrieval,  Lewin's  sorting  scheme  [11] 
which  requires  a  smallest  number  of  interrogating  cycles  and  is  independ¬ 
ent  of  the  number  of  bits  per  word  is  employed. 

2) .  The  sequential  writing  process  and  the  nonordered  information 
retrieval  can  be  performed  automatically  because  a  circuit  for  automatic 
sequential  dematching  operation  is  employed.  Manual  parallel  dematching 
operation  can  be  used  for  dematching  all  excessive  empty  words  after 
sequential  writing. 
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1.  INTRODUCTION' 


The  associative  memory*,  since  its  inception  in  1956  [l],  has  mani¬ 
fested  considerable  interest  and  attention  in  the  field  of  computer  and 
information  sciences  and  has  been  developed  in  a  variety  of  aspects 
[1-30].  In  contrast  to  the  location  or  coordinate  address  as  used  in 
a  random  access  memory,  this  type  of  storage  stores  and  retrieves  in¬ 
formation  on  the  basis  of  content  address.  In  other  words,  a  word  is 
written  into  an  associative  memory  without  assigning  an  address  and 
selecting  a  location,  and  is  retrieved  from  the  storage  by  simply 
searching  a  part  or  all  of  the  content  of  that  word.  Because  the 
housekeeping  task  inherent  in  a  conventional  memory  system  is  reduced 
to  a  considerable  extent,  the  operating  speed  of  an  associative  memory 
system  is  increased  and  programming  such  a  system  is  simplified.  Since 
words  in  an  associative  memory  are  identified  and  addressed  by  their 
contents,  an  address  decoder,  an  address  register,  and  a  selection 
ir  trix  which  arc  required  in  a  conventional  memory  system  are  no  longer 
used.  Thus,  the  cost  of  the  required  distributed  logic  circuits,  inter¬ 
rogating  digit  drivers,  and  some  other  necessary  networks  may  be  compen¬ 
sated  by  these  eliminated  devices.  Another  important  attribute  of  an 
associative  memory  system  arises  from  parallel  processing  capability 
because  most  operations  can  be  performed  on  the  basis  of  parallel 
manner.  Therefore,  a  processor  consisting  of  an  associative  memory 
offers  attractive  and  efficient  solutions  to  some  difficult  program¬ 
ming  problems  in  a  conventional  digital  computer,  such  as  ordered 
information  retrieval  or  sorting  [3,6,7,11,19],  dynamic  storage  alloca¬ 
tion  [10,14,28,31],  and  possibly  table  loop-up  [10],  list  processing 
[10],  etc.  Moreover,  pattern  recognition  [20,23,25,30],  bulk  pro¬ 
cessing  including  arithmetic  algorithms  [14,16,26,27,30],  logical  op¬ 
erations  [12,14,17,25,26,29],  and  matrix  inversion  [27],  and  many  other 
functions  [20-23]  can  be  easily  and  efficiently  performed  by  the  use  of 
content  addresses  and  parallel  operations. 

The  associative  memories  and  processors  appeared  in  literature 
have  been  organized  in  different  ways  and  implemented  by  using  various 


*Thc  associative  memory  is  also  called  the  catalog .  data -addressed , 
con  tent -addressed  or  parallel -search  memory . 
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types  of  circuit  elements,  such  as  cryotrons  [1-3,7-10,  19,  24],  mag¬ 
netic  components  [4,5,13,25,29],  semiconductor  devices  [15,17],  and 
possibly  plated  wires  [26],  Although  various  associative  memory  sys¬ 
tems  have  been  proposed,  many  schemes  of  the  early  work  seem  to  be 
either  too  primitive  or  too  complex  to  satisfy  all  the  requirements 
of  an  associative  memory  system  and  to  accomplish  many  applications 
by  means  of  the  same  system. 

In  this  thesis,  we  shall  use  cryotrons  and  outpoint  cells  [32] 
for  designing  two  associative  memory  systems  in  distinct  logical  struc¬ 
tures.  Both  systems  are  so  organized  that  their  structures  are  simple 
and  compatible  with  the  batch  fabrication  of  integrated  circuits.  Fur¬ 
thermore,  both  systems  can  perform  ordered  information  retrieval  follow¬ 
ing  Lewin’s  sorting  method  [11],  pattern  recognition  and  nonbulk  two- 
summand  additions  of  signed  binary  numbers  in  the  signed-2* s-complement 
number  system.  For  each  of  our  systems,  the  basic  operations  include 
comparison,  reading,  writing,  sensing  and  output-summing  processes.  The 
comparison  process  is  performed  by  using  an  appropriate  interrogating 
word  for  parallel  searching  all  the  memory  words.  During  comparison, 
a  bit-position  corresponding  to  all  bit-memories  of  equal  significance 
can  be  masked  out.  All  the  other  processes  are  also  performed  on  the 
basis  of  p3rallel-by-bit .  The  sensing  and  the  output- summing  processes 
are  respectively  used  for  ordered  retrieval  and  pattern  recognition. 

In  pattern  recognition,  each  pattern  class  is  allowed  to  have  deviations 
in  size,  style,  orientation,  etc.  within  certain  limits.  Because  each 
input  pattern  is  processed  with  the  prestored  templates  for  all  the 
pattern  classes  simultaneously,  the  speed  is  very  high.  It  is  found 
that  most  input  patterns  arc  recognized  within  first  comparison  process 
and  no  patterns  require  more  than  two  processing  cycles  for  their  recog¬ 
nition.  Since  each  template  can  accomodate  to  a  number  of  deviated  in¬ 
put  patterns  belonging  to  the  same  class,  the  storage  capacity  can  be 
greatly  saved.  The  proposed  hardware  approach  of  the  nonbulk  two- 
summand  additions  may  have  the  advantage  of  reducing  the  addition  time 
relative  to  the  existing  software  approaches  for  arithmetic  algorithms, 
because  of  possible  parallel  operations. 

In  this  thesis,  chapters  2  and  3  contain  respectively  the  cryogenic 
and  the  cutpoint  cellular  associative  memory  systems.  Chapter  4  present 


I  \ 
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the  pattern  recognition  scheme  by  using  an  associative  processor. 
Chapter  5  describes  the  arithmetic  operation.  A  selected  biblio¬ 
graphy  showing  the  progress  of  associative  memories  and  processors 
in  the  past  decade  is  included. 
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3) .  The  logical  structure  of  the  whole  system  is  much  simpler  be¬ 
cause  multiple-controlled  cryotrons  are  used  and  the  operations  of  some 
processes  are  automatic.  Every  bit-memory  and  every  cryogenic  selec¬ 
tion  and  control  '^rcuit  for  each  word  contain  fewer  cryotrons  compared 
with  the  existing  systems  on  the  basis  of  performing  equivalent  functions, 

4) .  The  variation  of  the  circuit  inductances  for  different  tagged 
words  during  reading  and  writing  and  the  number  of  stage  delays  for  each 
process  are  both  small.  Hence,  the  time  interval  between  the  pulses  for 
automatic  reading  and  writing  can  be  reduced  (because  the  time  interval 
has  to  be  designed  according  to  the  word  with  the  largest  circuit  induct¬ 
ance),  and  the  operating  speed  is  consequently  increased. 

5) .  In  contrast  to  the  ordinary  memory  systems  in  which  the  inform¬ 
ation  bits  are  restricted  to  be  "0"  and  "1",  this  memory  may  contain  an 

additional  empty  "e"  besides  "0"  &  "1".  Since  we  may  have  "e"  in  an  in- 

* 

terrogating  word,  the  destructive  reading  procedure  is  simplified  . 

It  is  noted  that  in  ordered  retrieval,  "e"  is  allowed  to  appear  only  in 
the  equal  significant  bit-position  of  all  the  occupied  words  because  "e" 
is  undefined  as  far  as  its  magnitude  is  concerned;  however,  there  is  no 
such  restriction  in  non-ordered  retrieval. 

6) .  The  reading  process  may  be  either  destructive  or  nondestructive. 
In  this  chapter,  we  shall  firs'-  present  the  logical  structure  of  the 

cryogenic  associative  memory,  and  then  describe  the  operations  of  each 
process  separately.  The  technical  terms  employed  in  the  following  sec¬ 
tions  can  be  found  in  Appendix  I. 


*In  ordinary  cryogenic  associative  memory,  the  interrogating  word  can 
have  only  the  "0"  and  "1"  bits.  In  order  to  search  the  empty  words,  the 
interrogating  word  used  is  a  word  consisting  of  "0"  only.  There  arc 
two  different  ways  to  differentiate  the  "0"  and  "1";  One  is  to  use  a 
nonzero  persistent  current  representing  "l"  and  a  zero  persistent  current 
representing  "0";  and  the  other  is  to  use  the  two  different  directions  of 
the  persistent  current  to  differentiate  v0"  and  "l”.  In  the  former  case, 
there  is  no  way  to  distinguish  an  empty  bit-memory  and  a  memory  occupied 
by  a  "0"  information  bit,  and  hence  ambiguity  may  arise.  In  the  latter 
case,  during  the  destructive  reading  process,  the  information  words 
which  have  been  read  out  are  first  erased,  and  then  we  have  to  write 
the  "0"  bits  in  their  bit-memories.  Tf  we  can  have  "e"  in  the  interro¬ 
gating  word,  an  empty  word  can  merely  be  a  memory  register  in  which 
each  bit-memory  has  zero  persistent  current.  This  eliminates  the 
writing  step  in  the  destructive  reading  process. 
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2.2.  THE  LOGICAL  STRUCTURE 


The  arrangement  of  the  n  bit-memories  and  a  selection  and  control 
circuit  for  each  of  the  m  memory  words  of  the  proposed  cryogenic  asso¬ 
ciative  memory  system  is  shown  in  Fig.  1.  The  memory  words  are  number¬ 
ed  from  the  top  to  the  bottom.  The  logical  structure  of  a  typical  mem¬ 
ory  word  including  a  selection  and  control  circuit  and  n  bit-memories 
is  shown  in  Fig.  2.  Since  there  are  some  differences  in  the  connection 
of  the  selection  and  control  circuit  for  an  odd-numbered  word  and  an 
even-numbered  word,  the  typical  word  i  shown  in  Fig.  2  is  assumed  to  be 

odd-numbered.  If  the  word  i  becomes  even-numbered,  the  C__  and  M  lines 

*  *  ML 

should  be  the  dotted  lines  marked  as  and  M^,  shown  in  Fig.  2.  Now 
we  describe  each  part  of  the  memory  system  separately. 

2.2a.  Bit-Memories 

As  shown  in  Fig.  2,  each  bit-memory  consists  of  5  cryotrons,  16 

connecting  terminals  and  one  memory  loop.  The  comparison,  enable -mask. 

read-sense,  auxiliary  sense,  and  write  cryotrons  in  the  bit-memory  ij 

are  denoted  by  C  . ,E. , ,R. . ,S . , ,  and  respectively.  We  also  use  these 
ij  ij  ij  ij  ij 

symbols  to  represent  the  binary  variables,  each  of  which  may  be  either 
"0"  or  "1"  indicating  the  corresponding  cryotron-gate  being  in  the  re¬ 
sistive  or  superconductive  state  respectively.  From  now  on,  if  a  symbol 
is  used  as  the  label  of  a  cryotron  or  a  line  containing  cryotron-gates, 
this  symbol,  when  it  appears  in  an  equation,  is  also  used  as  a  binary 
variable  being  either  "0"  or  "1"  indicating  the  corresponding  cryotron- 
gate  or  the  corresponding  line  being  resistive  or  superconductive.  If 
a  symbol  is  used  as  the  label  of  a  pulse  type  or  d-c  current,  this  symbol, 
when  it  appears  in  an  equation,  is  also  used  as  a  binary  variable  being 
either"0"  or  "1"  indicating  the  corresponding  current  being  respectively 
smaller  or  larger  than  the  critical  current  which  keeps  all  the  cryotron- 
gates  controlled  by  that  current  in  the  resistive  state.  It  is  noted 


that  the  nonzero  persistent  current  1^  circulating  in  every  memory  loop 
should  be  larger  than  the  critical  current  of  but  smaller  than  the 
critical  currents  of  and  R  .  Furthermore,  because  of  the  arrange¬ 
ment  of  the  lines  W_.  and  W„.,  the  mutual  induced  currents  in  every  mem- 

ory  loop  due  to  the  multiple-controlled  cryotrons  S  and  R  are  cancelled, 

— ■  3  ^  J 

and  hence  there  is  no  unsatisfactory  result  caused  by  these  induced 


currents. 


The  logical  structure  of  the  proposed  cryogenic  associative  memory 


9 


In  Ftgs.l  and  2,  we  see  that  the  controls  of  the  enable-mask  cryotrons 


E. .  through  E  .  are  connected  in  series  to  form  the  enable-mask  line  E„. 
lj  mj  -  Mj 

for  the  j-th  bits  of  all  the  words.  The  read-sense  line  Rc .  and  the  aux- 


Sj 


lliarv  sense  line  are  formed  in  the  similar  manner  by  connecting  the 


gates  of  the  read-sense  cryotrons  Rj^  through  R  in  series  and 


through  S  in  series  respectively.  Hence,  we  have  the  following  equa- 
mj 


tions : 


R 


Sj 


m 
=  IT 

i*=l 

Q 

n 

i=i 


R 


i  j  * 


(1) 

(2) 


where  j  -  l,2,...,n,  and  the  operation  "multiplication"  is  the  same  as 
Boolean  product.  In  fact,  in  all  the  equations,  the  operations  addition 
and  multiplication  and  the  bar  over  a  binary  variable  are  the  same  as  the 
addition,  multiplication  and  complementation  of  a  binary  variable  in 


Boolean  algebra  respectively.  Let  IRS^  be  the  current  in  the  read-sense 


in  the  auxiliary  sense  line  S  ,  and  V  be  the  voltage 

J 


line  R_,and  I_. 

across  R_  and  V  across  S  .  Then,.  V„  and  V  can  be  expressed  by  the 
bj  bj  j  Kbj  bj 

following  equations: 


V  =  R  I 
RSj  Sj  RSj  * 


'Sj 


Vsj’ 


(3) 

(4) 


for  j  =  l,2,...,n.  The  line  which  connects  all  the  memory  loops  in  the 


j-th  bit-column  forms  the  write-interrogate  line  which  can  be  excited 


by  the  current  pulse  Lyjj  during  the  interrogating  or  writing  period. 


The  magnitude  of  should  be  twice  of  the  persistent  current  I  for  the 

bit  of  "0"  or  "1",  and  zero  for  "e".  The  positive  (upward)  or  negative  (down¬ 


ward)  pulse  of  I, 


Wlj 


corresponds  to  the  bit  "1"  or  "0"  respectively. 


This  convention  is  shown  in  Table  1. 

2.2b.  Word  Selection  and  Control  Circuits 

For  each  word,  there  is  a  selection  and  control  circuit  in  addition 
to  the  n  identical  bit-memories.  This  circuit  for  each  word  consists  of 
8  cryotrons  and  their  associated  lines  as  shown  in  Fig.  2.  The  comple¬ 
mentary  pair  of  the  sequencing  cryotrons  and  is  used  to  tag  the 
i-th  word  for  performing  the  subsequent  sensing,  reading  or  writing 
process  if  word  i  is  matched  by  a  comparison  process.  Their  gate-states 


and  that  of  the  match-indication  cryotron  are  controlled  by  the  com¬ 
parison  current  in  the  comparison  line  C^.  The  cryotrons  Sg^  ,  Wgi 
and  Rg^,  which  are  called  the  sense-inhibit .  write-inhibit .  and  read- 
lnhibit  cryotrons  are  used  respectively  for  the  inhibition  of  the  sensing, 
writing,  and  reading  circuits  of  the  i-th  word.  The  controls  of  the  sense- 

inhibit  cryotrons  S_.  through  S  are  connected  in  series  to  form  the  sense- 

til  Bm 

inhibit  line  S_,  which  is  excited  bv  the  current  I__  in  of  either  polarity 
"  B  bti  B 

during  the  sense-inhibition.  The  write-inhibit  line  W„  "and  the  read-inhibit 

________ 

line  Rg  are  formed  and  function  in  the  similar  manner.  Furthermore,  the 
cryotron-gates  satisfy  the  following  conditions: 

0 


Vbi 

sbAi 


(5) 


V*B1  ■  ° 

and  ^iAAi  ' 0 

for  i  =  1,2, .. .  ,m.  The  cryotron  Cgi  in  the  bypass  branch  Cg^  of  the  word- 

comparison  line  WCi  of  word  i  is  called  the  comparison-set  cryotron.  The 

controls  of  C„,  through  C_  are  connected  in  series  to  form  the  comparison- 

set  line  C_.  The  cryotron  D  ,  called  the  dematching  cryotron  of  word  i  has 

a  double-control  and  is  used  to  dematch  the  selected  i-th  word.  One  of  the 

controls  of  D.  connected  between  the  terminal  WR  and  the  common  terminal  of 
l  o 

the  gates  of  Wg.  and  Rg^  is  used  for  performing  the  automatic  dematching 

operation.  The  other  controls  of  D. through  D  are  connected  in  series  to 

*  m 

form  the  dematching  line  D,  which  is  used  for  performing  the  manual  de- 
matching  operation. 

2.2c.  Word-Write-Read-Sense  Circuit 

The  word-sense  circuit  of  word  i  is  the  circuit  between  the  terminals 
WR^  and  WR^+^,  which  consists  of  two  parallel  branches:  One  is  the  word- 
sense  line  W  containing  the  gates  of  the  cryotrons  Q  and  S  and  the 

i  jji 

controls  of  the  cryotrons  R, ,  through  R  and  S  through  S  ,  and  the 

ii  in  __  ii  in 

other  is  the  gate  circuit  of  the  cryotron  Q^.  The  state  of  the  i-th-word- 
sense  circuit  W  is  given  by  the  equation 


w, 


SCi 


Q  +  S 
xi  Bi 


for  i  =  l,2,...m,  provided  that  (5)  is  satisfied. 


(6) 


1? 


The  word-write-r cad  circuit  of  word  i  starts  from  the  terminal  WR 


to  the  terminal  WR^.  It  includes  the  gate  of  the  cryotron  the  par¬ 

allel  connection  of  the  word-write  line  W„.  and  the  word-read  line  W_ 


Wi 


Ri’ 


and  one  of  the  controls  of  D..  The  word-write  line  V?  is  the  series 

i  wi 


connection  of  the  controls  of  W^  through  and  the  cryotron-gates  W 


and  Q..  The  word-read  line  W  consists  of  the  cryotron-gates  RD,  and 
1  Kl  x>i 


Q.  and  the  part  of  the  word-sense  line  W„.  which  is  the  series  connection 
i  Si 


of  the  controls  of  R  through  R  and  S  through  S.  shown  in  Fig.  2.  The 

ix  in  n  in  ° 


function  of  the  word-write-read  circuit  between  the  terminals  WR 

WRi  o 


and  WR^,  can  be  expressed  logically  as  follows: 


«WRi  '  «i  +  SBi>  <HBi  +  V’ 


(7) 


for  i  =  1,2,. . . ,m. 

Figs. 3  and  4,  in  which  the  shaded  or  unshaded  circle  represents 
respectively  the  resistive  or  superconductive  state  of  a  cryotron-gate, 


show  how  the  write-rcad-sense  current  I^g  will  flow  in  the  superconductive 


word-write-read-sense  circuit  for  the  first  matched  word  and  a  mismatched 
word  respectively.  In  each  case,  all  the  three  possible  operations  are 
illustrated.  It  is  seen  that  there  is  one  and  only  one  superconductive 


path  for  I. jpq  passing  through  each  word  under  all  the  circumstances.  It 

WKl) 


follows  from  (5)  and  (7)  that 


WWRi  =  VBi 


(8) 


for  i  =  l,2,...,m.  Because  (6)  and  (8)  are  exactly  complementary  to  each 

other  and  all  the  word-write-read-sense  circuits  are  connected  as  shown  in 

Fig.  1,  the  transmission  function  f  between  the  terminals  WR,  and  WR  and 

o  1  o 

^m-KL  Between  WR^  and  WR^^  are  giveft  «by  .the  following  equations: 


m 


m 


f  =  £ 


w. 


i=l 


=  £  Q  s 

Xi  Bi 


SGi  .=1 


<9> 


m 


m 


f  =  n,  w„  »  n  (q.+s_ .) 

mrfl  i=l  SCi  i=1  i  Bi 


(10) 


The  above  two  equations  which  are  complementary  to  each  other  can  be  ex¬ 
pressed  in  terms  of  the  currents  Ig^  and  1^,^  passing  through  the  sense- 


inhibit  line  Sn  and  the  bypass  branch  C_ .  of  the  i-th  word  comparison  line 
5  D1 


W„.  as  follows: 

Ci 


4  * 

I; 


3  i 


2K1 


The  states  of  the  cryotron-gates  and  the  flow  of  the  current  pulse 
I  in  the  superconductive  path  of  the  word-write-read-sense 
circuit  of  the  first  matched  word  i,  when  the.  circuit  (a)  V’ 

(b)W  or  (c)  W  .  is  selected. 


The  states  of  the  cryotron-gates  and  the  flow  of  the  current  pulse 
E  in  the  superconductive  path  of  the  word-write-read-sense  circuit 
oY11!  mismatched  word  labelled  with  a  smaller  number  than  that  of  the 
first  matched  word  when  the  circuit  (a)  0>)W^  or  (c)  Wg^  is  selected. 


Will 


V 
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m  _ 

fo  =if1  ICBiISB 


fm+l  (ICBi+^SB). 
1=1 


(U) 


(12) 


2. 2d.  Comparison  Circuit 

The  comparison  circuit  consists  of  m  word-comparison  circuits.  The 
word-comparison  circuit  cf  word  i  is  the  parallel  connection  of  the  word- 
comparison  line  W,,.  and  its  bypass  C  as  shown  in  Fig.  2,  and  its  logic 

Cl  151 

equation  is  given  by 

(13) 


VI  =  D  n  (C.  .+  E  .)  +  C_. , 
CMi  ij=1  ij  ij  Si’ 


for  i  =  1,2,..., m.  This  equation  can  be  expressed  in  terms  of  the  currents 
controlling  the  cryotrons  in  the  word-comparison  circuit  as  follows: 

<»*> 


W  =11  II 
CMi  D  WRS  " 

j"1 


Cij 


:Mj' 


^cs’ 


where  lCij  Is  the  net  current  passing  through  the  control  of  C  _ ,  which  is 

algebraic  sum  of  I^j2  due  to  the  current  pulse  applied  to 

and  the  persistent  current  I  in  the  bit-memory  ij.  It  is  noted  that  due 

to  the  convention  of  I  and  I„T .  for  the  information  bit  we  have  defined 

P  Wlj 

in  Table  1,  the  cryotron-gate  C  is  in  the  superconductive  state  if  the 
stored  information  1^  in  the  bit-memory  ij  and  the  interrogating  informa¬ 
tion  I._  .  are  matched  and  resistive  otherwise.  We  know  the  current  in  the 
wlj 

control  of  C  due  to  the  interrogating  current  source  in  the  j-th  column 
is  Xyjj/2  because  the  two  sides  of  the  memory  loop  between  the  connections 
of  the  write-interrogate  line  have  the  same  inductance  when  the  cryo¬ 
tron-gate  W  is  superconductive. 

The  comparison  circuit  is  the  series  connection  of  the  m  word-compari¬ 


son  circuits  W_.„  through  . 

CMI  CNm 


Its  logic  equation  is  given  by 


m  p_ 

M-.\  Lv 

1=1 


n 

n 


WRS (ICij+  XCMj*  +  *CS  1  * 


(15) 


2.2e.  Match-Indication  and  Memory-Clear  Circuit 

The  match-indication  line  Mj  is  the  series  connection  of  the  cryotron- 

gates  Mt,  through  M_  as  shown  in  Fig.  1.  The  match-indication  voltage 
1 1  Lm 

across  the  line  M^.  is  equal  to  ,  where  co  is  the  number  of 

matched  words,  I  is  the  constant  current  applied  to  the  M^  line,  and 
is  the  resistance  of  a  match-indication  cryotron-gate  when  it  is 


in  the  resistive  state. 


Itn  Timnrri»T»KWi*'i 


The  memory-clear  line  M^,  is  the  series  connection  of  one  of  the 
controls  of  all  the  write  cryotron  W^  in  the  memory  as  shown  in  Figs.  1  and  2. 
2.3.  OPERATIONAL  PROCEDURES 
2.3a.  Comparison  Process 

The  comparison  process  is  required  to  select  memory  words  for  reading, 
writing  or  sensing  process.  We  shall  describe  various  comparison  techni¬ 
ques  due  to  different  interrogating  words,  and  the  procedure  for  comparison 
in  this  section. 

When  the  interrogating  word  consists  of  only  the  don't-care  bits  "0", 
the  comparison  process  is  called  the  masked  comparison.  It  may  be  employed 
during  the  initial  interrogating  cycle  of  the  ordered  retrieval.  We  shall 
see  that  by  this  process  all  the  descriptors  "0",  "1"  or  "e"  of  the  matched 
words  can  be  identified  respectively  by  the  "sense  0",  "sense  l"or  "sense  Y" 
at  the  double-sense  line  Rc,  and  S  .  When  the  interrogating  word  consists 
of  "0",  "1"  and  "e"  but  no  "0",  the  process  is  called  the  enabled  comparison. 
This  method  is  used  when  a  particular  record  is  to  be  retrieved  from  a  large 
file  stored  in  the  memory  system.  The  comparison  result  is  indicated  by 
either  "matching"  or  "mismatching".  When  the  interrogating  word  consists 
of  "0",  "1",  "e"  and  "0",  the  process  is  called  the  enabled-masked  compari¬ 
son.  In  fact,  a  bit  column  containing  all  equal  significant  bits  of  the 
memory  words  is  said  to  be  masked  out  during  a  comparison  process  if  the 
corresponding  interrogating  digit  for  the  comparison  process  is  "0".  This 
method  is  usually  employed  in  most  comparison  processes.  It  is  noted  that 
the  "e"  in  the  interrogating  word  for  ordered  retrieval  is  not  used  because 
"e"  is  restricted  to  be  a  descriptor  and  it  is  interrogated  by  a  "0  ". 

The  comparison  process  starts  with  applying  a  current  pulse  I^g  to 
the  comparison-set  line  Cg.  Then,  all  the  cryotron-gates  Cg,  through 
C  become  temporarily  resistive,  and  the  d-c  comparison  current  I  is 
compelled  to  flow  or  remains  flowing  through  the  word-comparison  lines 
Wr  through  W  because  at  this  time  there  are  no  currents  applied  to  the 
enable-mask  lines  E^  through  E^.  The  memory  words  are  then  interrogated 
by  the  current  pulses  1^.^  through  with  magnitudes  and  directions 
being  determined  by  the  interrogating  word  as  defined  in  Table  1.  It  is 
seen  that  the  cryotron-gate  C  will  change  to  the  resistive  state  when¬ 
ever  the  net  control  current  I„. ,  of  C . ,  reaches  I,„,/2.  After  all  the 

Cij  ij  Wlj 

necessary  state-transitions  are  completed,  the  enable-mask  current  Ig^j  Is 
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applied  to  each  enable-mask  line  according  to  the  corresponding 
Interrogating  digit.  It  follows  from  the  current  conventions  we  have 
chosen  that  there  is  at  least  one  pair  of  the  cryotron-gates  and 
being  both  resistive  if  and  only  if  the  i-th  word  is  not  matched. 

In  this  case,  1^  is  switched  to  the  bypass  branch  of  WCi  and  the 
gates  of  and  become  superconductive.  On  the  other  hand,  if  the 
i-th  word  is  matched,  remains  superconductive  and  1^  is  kept  flowing 

through  W^,  and  consequently  the  gates  of*Q^  and  remain  resistive. 
Therefore,  the  voltage  across  the  gate  of  being  nonzero  or  zero  in¬ 
dicates  whether  the  i-th  word  is  matched  or  mismatched.  After  all  the 
pulses  an<*  I^j  vanish,  the  comparison  process  terminates  and  the 

d-c  comparison  current  1^  has  established  its  distribution  to  control 
the  gate-states  of  (^through  and  through  Q^,  which  selects  all  the 
matched  words  for  subsequent  writing,  reading  or  sensing  operation. 

The  time  sequences  shown  in  the  left  part  of  Fig.  5  illustrate  the 
comparison  process  for  selecting  the  empty  words  (assume  the  i-th  word 
is  empty).  In  Fig.  5,  the  switching  time  of  a  cryotron  is  denoted  by 
T  with  the  label  of  the  cryotron  as  its  subscript. 

2.3b.  Writing  Process 

The  process  of  storing  information  into  an  associative  memory  is 
called  writing.  To  do  writing,  we  first  have  to  find  all  the  empty  words, 
each  of  which  consists  of  only  the  empty  "e".  This  can  be  accomplished 
by  an  enabled  comparison  with  a  string  of  "e"  as  the  interrogating  word. 

If  there  are  no  empty  words,  we  can  clear  the  occupied  words  by  exciting 
the  memory  clear  line  M^,. 

After  locating  the  empty  words,  the  writing  circuit  is  selected  by 
exciting  the  sense-inhibit  line  and  the  read-inhibit  line  Rg  and  leaving 
only  the  write-inhibit  line  Wg  unexcited.  The  situation  for  the  first 
matched  word  and  a  mismatched  word  are  shown  in  Figs.  3(a)  and  4(a)  res¬ 
pectively.  The  information  to  be  stored  is  written  in  by  applying  the 
current  pulses  1^^  through  Iy^  to  the  write-interrogate  lines 

through  W_  according  to  the  convention  shown  in  Table  1.  At  the  same 
a  n 

time  a  current  pulse  I^^g,  whose  source  is  turned  on  by  the  match-indica¬ 
tion  voltage  V^.,  is  fed  to  the  terminal  WR^.  The  cryotron-gates 

through  W^n  in  the  first  matched  empty  word  i  become  temporarily  resis- 
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i 

i 


tive  and  hence  each  of  the  current  pulses  Itrr,  through  I  passes 

wl 1  Win 

through  the  right  branch  of  each  memory  loop.  When  W^  through  W^ 

become  superconductive  again  1^  through  1^  vanish  and  the  appro¬ 
priate  persistent  currents  in  word  i  are  established.  The  newly 
occupied  word  i  is  automatically  dematched  after  the  dematching  cryo¬ 
tron  is  changed  from  superconductive  state  to  resistive  state  by 
*WRS*  writing  procedure  is  then  repeated  for  the  next  matched 

empty  word.  The  process  terminates  after  all  the  new  information  has 
been  written  in  or  after  all  the  matched  empty  words  are  occupied.  In 
the  former  case,  the  dematching  line  D  may  be  excited  at  the  instant  of 
completing  the  writing  of  new  information;  and  in  the  latter  case,  the 
match-indication  voltage  V._  is  reduced  to  zero,  and  the  It__  source  is 
turned  off.  It  is  noted  that  the  switching  time  T^  of  D^.  must  be  greater 

than  T  of  W  in  order  to  complete  the  writing  procedure  before  the  word 
W  I  j 

i  is  dematched.  In  fact,  it  will  be  seen  later  that  T^  also  should  be  great¬ 
er  than  T  and  T  .  The  time  sequences  shown  in  the  right-hand  part  of 
K  b 

Fig.  5  illustrate  the  writing  procedure  in  which  a  bit  "l"  is  written 
in  the  matched  empty  bit-memory  ij^ 

2.3c.  Non-Ordered  Retrieval 

To  do  non-ordered  retrieval,  an  enabled-masked  comparison  is  first 
performed  to  match  all  the  desired  words  to  be  retrieved  from  the  memory 
system.  This  is  done  by  using  the  common  identifier  of  all  the  desired 
words  to  be  retrieved  as  the  enabled  part  of  the  interrogating  word. 

Then,  the  word-read  circuit  is  selected  by  exciting  the  write- inhibit  line 
Wg  and  the  sense-inhibit  line  and  leaving  only  the  read-inhibit  line  Rg 
unexcited.  The  situations  for  various  words  are  shown  in  Figs.  3(b)  and 
4(b).  Then  applying  the  current  pulse  to  the  terminal  WR^  and  d-c 

currents  to  all  the  double-sense  lines  R^^,  through  Rg^  and  S^,  through  S^, 
the  first  matched  word  i  is  read  out  by  measuring  the  voltages  across 
all  the  double-sense  lines.  It  follows  from  the  convention  defined  in 
Table  2  that  the  values  (0,1),  (1,0)  and  (0,0)  of  the  voltage  pair  (V  , 

Kbj 

V  ,)  appearing  in  the  double-sense  line  R  and  S  daring  the  non-ordered 

bj  j 

reading  process  correspond  to  "0",  "1"  and  "e"  respectively.  We  can  see 
that  only  needs  to  be  measured  if  each  bit-memory  in  the  tagged  word 

contains  either  ”0"  or  ’'l".  The  word  i  is  automatically  dematched  after 
the  dematching  cryotron  is  changed  from  superconductive  state  to 
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resistive  state  by  the  first  current  pulse  I  .  and  the  next  current 

WRS 

pulse  will  go  to  the  next  matched  word.  Thus,  all  the  matched  words 

are  read  out  sequentially  according  to  the  ascending  order  of  the  matched- 

word-position  numbers.  After  all  the  matched  words  are  read  out,  the  match* 

indication  voltage  V^.  is  reduced  to  zero  which  turns  off  I  and  the  d-c 

currents  to  R01  through  R_  and  S,  through  S  ,  and  the  reading  process 
si  bn  1  n 

ends. 

It  is  noted  that  the  above  reading  process  is  non-destructive.  For 
destructive  reading,  the  procedure  is  to  excite  the  sense-inhibit  line 
Sg  and  the  read-inhibit  line  Rg  and  leaving  the  write-inhibit  line  W£  un¬ 
excited.  When  the  current  pulse  1,TO_  is  applied  to  the  terminal  WR  ,  the 
voltage  appearing  on  Wj.  is  zero  or  a  non-zero  pulse  of  either  polarity 
according  to  whether  the  information  in  the  j-th  bit-memory  of  the  first 
matched  word  i  is  "e",  "0"  or  "1"  respectively.  The  polarity  of  a  non¬ 
zero  voltage  pulse  on  W^  representing  "0"  or  "1"  can  easily  be  deter¬ 
mined  by  the  convention  of  the  persistent  current  we  have  used.  It  is 
noted  that  when  I^g  passes  through  W^,  the  persistent  current  in  every 
bit-memory  of  word  i  is  reduced  to  zero  because  every  cryotron-gate  W 
in  word  i  becomes  resistive.  Same  as  the  non-destructive  reading  process, 
the  i-th  word  is  dematched  as  soon  as  the  dematching  cryotron  is 

changed  from  superconductive  state  to  resistive  state  by  I  and  the 

WRS  j 

next  pulse  I^pg  will  go  to  the  next  matched  word.  The  method  of  using 
the  word-write  line  W  for  destructive  reading  is  first  employed  by 

Wi 

Ahrons  [19]. 

2.3d.  Ordered  Retrieval 

For  ordered  retrieval,  a  sorting  scheme  is  required  to  read  out  all 
the  desired  words  sequentially  in  an  ascending  (or  descending)  order  of 
the  magnitudes  of  their  binary  equivalent  values  after  all  the  desired 
words  are  matched  by  a  comparison  process.  The  sorting  scheme  used  in 
this  system  is  described  in  the  flow  chart  shown  in  Fig.  6,  which  is  the 
same  as  Lowin' s  method  [11],  except  that  the  sensing  results  are  inter¬ 
preted  differently  in  order  to  include  the  possibility  of  the  appearance 
of  "e"  in  the  desired  word  contents. 

Before  we  discuss  the  details  of  ordered  retrieval  in  our  system, 
let  us  consider  another  process,  namely  the  sensing  process,  which  is 
required  in  ordered  retrieval.  This  process  is  used  to  generate  the 


=  1?  w 


Read  out 
Matched 
Word 


sensing  result  which  indicates  the  contents  of  all  the  matched  words  of 
a  given  comparison  process.  This  process  can  be  described  as  follows: 
After  a  given  comparison  process,  the  word-sense  circuit  is  selected  by 
exciting  the  read-inhibit  line  R_  and  the  write-inhibit  line  W  and 

D  u 

leaving  only  the  sense-inhibit  line  unexcited.  The  situations  for  the 

1st  matched  word  and  a  mismatched  word  are  shown  in  Figs.  3(c)  and 

4(c)  respectively.  Then,  the  current  pulse  is  applied  to  the 

terminal  WR^  and  d-currents  to  all  the  double-sense  lines  Rg^  through 

R_  and  S,  through  S  .  The  voltage  pair  (V.,_.,V0.)  across  the  double- 
Sn  1  n  RSj  oj 

sense  line  R  and  S  may  have  four  different  values,  whose  correspond- 
bj  j 

ing  bit  contents  are  shown  in  Table  2.  Lewin's  assignment  for  these 
values  is  also  listed  in  order  to  compare  the  one  used  in  our  system. 

It  is  seen  that  the  possibility  of  "e"  appearing  in  the  contents  of 
matched  occupied  words  is  included  in  our  assignment.  The  sensing 
process  terminates  when  the  current  pulses  I^s  and  those  in  all  the 
double-sense  lines  vanish. 

The  sorting  scheme  for  ordered  retrieval  shown  in  Fig.  6  consists 
of  2  CD-I  interrogating  cycles  for  y>  matched  occupied  words.  Each  interro¬ 
gating  cycle  consists  of  a  comparison  process  and  a  sensing  process. 

The  first  interrogating  cycle  starts  with  the  comparison  process  to  match 
all  the  desired  words  to  be  retrieved  in  the  memory  system.  In  this  com¬ 
parison  process,  the  interrogating  word  must  contain  some  "0"  in  its  bits 
and  all  others  are  either  !,0"  or  "1".  Each  initial  interrogating  digit 
dj  which  is  not  ”0"  must  be  a  common  identifier  digit  of  all  matched 
words,  and  hence  it  has  no  effect  on  the  ordered  retrieval.  Therefore, 
we  only  consider  those  bit-positions  which  are  "0"  in  the  interrogating 
word.  After  each  comparison  process, we  apply  a  sensing  process  to  ob¬ 
tain  the  sensing  results  Z^  through  for  all  bit-columns  which  are 
interpreted  according  to  Table  2.  Because  "c"  must  be  a  descriptor  in 
ordered  retrieval,  ambiguity  arises  only  when  "X”  appears  in  the  sensing 
result.  If  we  want  to  retrieve  all  the  desired  words  in  the  ascending 
order  of  the  magnitudes  of  the  binary  values  of  their  word  contents,  "0" 
is  changed  to  "0"  starting  from  the  left  to  the  right  until  no  "X"  appear 
in  the  sensing  result.  At  this  stage,  the  word  with  the  minimum  magnitude 
of  word  content  is  matched.  After  the  matched  word  is  read  out,  the  same 
digits  are  changed  from  "OH-*-"l",-»''0",-*  "o",-*"!"  in  the  interrogating 


words  for  the  subsequent  interrogating  cycles,  starting  from  the  right 
to  the  left.  This  procedure  is  expressed  in  the  flow  chart  shown  in 
Fig,  6,  and  an  example  is  given  in  Table  3  which  retrieves  out  all  the 
stored  words.  If  we  want  to  retrieve,  all  desired  words  in  the  descending 
order  of  the  magnitudes  of  the  binary  values  of  their  word  contents,  the 
procedure  is  the  same  except  that  "0"  is  first  changed  to  "1",  and  then 
"0" -»  "1",-*  "0". 

It  is  noted  that  the  reading  process  used  in  the  ordered  retrieval 
may  be  non-destructive  or  destructive.  Their  operations  are  the  same 
as  in  the  non-ordered  retrieval  case. 


-  -  --  »«*>  ■>»- 


3.  A  CUT POINT  CELLULAR  ASSOCIATIVE  MEMORY  SYSTEM 

3.1.  INTRODUCTION 

In  this  chapter,  we  propose  an  associative  memory  implemented  by 
the  cutpoint  cellular  logic.  The  cutpoint  cellular  logic  which  was  first 
considered  by  Minnick[32]  consists  of  the  cutpoint  cells  with  various 
output  functions.  These  cells  are  especially  compatible  with  the  batch 
fabrication  of  integr  ud  circuits,  and  possess  the  advantages  of  high 
speed,  low  cost,  small  size  and  good  reliability. 

The  proposed  associative  memory  consisting  of  m  n-bit  words  is  also 
word-organized,  and  each  bit-memory  provides  a  pair  of  complementary 
outputs  which  satisfy  the  basic  requirement  for  the  ordered  retrieval 
based  on  Lewin's  scheme  [11].  The  selection  of  the  memory  words  for 
reading  or  writing  is  performed  by  a  simultaneous  comparison  and  a  tag 
operation.  The  tag  of  the  matched  words  can  be  performed  on  the  basis 
of  either  serial-by-word  or  parrallcl-by-word.  The  serial-by-word 
tagging  is  accomplished  by  using  a  controlled  shift  register.  The  dematch¬ 
ing  of  the  tagged  word  is  completely  automatic.  The  memory  sequential 
control  system  does  not  i\  e  any  ladder  structure  which  is  commonly  em¬ 
ployed  in  previous  associative  memory  systems,  and  hence  the  operating 
speed  is  largely  increased.  The  readout  of  stored  information  is  non¬ 
destructive.  The  stage  delays  for  various  operations  are  given,  and  may 
be  utilized  to  estimate  the  speed  of  the  associative  memory.  In  the 
following  sections,  the  logical  structure  and  each  operational  procedure 
will  be  described  separately.  The  derivations  of  several  stage  delays 
and  the  time  interval  for  the  shift  or  writing  pulses  can  be  found  in 
Appendix  II. 

3.2.  CUTPOINT  CELLS 

Before  presenting  our  proposed  cutpoint  cellular  associative  memory, 
we  first  describe  the  cutpoint  cells  [32],  which  are  the  basic  elements 
used  in  our  memory.  Each  cutpoint  cell  is  designated  by  an  index  k  and 
has  two  inputs  x  and  y  and  two  outputs  x  and  z  as  shown  in  Fig.  7.  The 
relations  between  the  output  z  and  the  index  k  are  listed  in  Table  4. 

It  is  noted  that  when  k=13,  the  cutpoint  cell  performs  as  a  set-reset 
flip-flop.  Thus,  wo  may  take  another  lead  from  the  cell,  which  has  the 
output  z,  where  z  is  the  complement  of  z.  It  will  be  seen  that  this 
additional  output  terminal  for  a  cutpoint  cell  of  index  13  will  help 
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Indices  and  Output  Functions  of  Minnick's  Outpoint  Cells  [32] 
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simplify  the  logical  organisation  of  our  memory.  In  Table  A,  we  also 

list  the  stage,  delays  T  for  the  outputs  of  outpoint  cells  with  various 

K 

indices.  They  will  be  used  to  estimate  the  operating  speed  of  our 
associative  memory. 

3.3.  THE  LOGICAL  STRUCTURE 

The  block  diagram  of  the  proposed  cutpoint  cellular  associative 
memory  is  shown  in  Fig.  8.  The  bit-memories  are  organised  in  the  usual 
manner.  Each  word,  except  the  first  one,  of  the  memory  contains  n 
identical  bit -memories ,  one  match-tag  network,  and  one  sequential 
control  network.  Hie  structure  of  the  first  word  is  the  same  as 
others  except  that  it  has  no  sequential  control  network.  The  m  bit- 
memories  of  equal  significance  have  a  com.'. von  pair  of  output  networks. 
3.3a.  Bi t-Mcmori es 

As  shown  in  Fig.  9,  the  biL-mor.ory  ij  belonging  to  the  j-th 

significant  digit  of  the  i-th  word  consists  of  nine  cutpoint  cells. 

The  input,  interrogating,  and  enabling-masking  lines  for  all  mbit- 

memories  lj  through  mj  arc  the  vertical  lines  X.,  Y  and  E.  respectively. 

The  double-sense  lines  are  labeled  by  their  output  functions  _  and 

M...Z..,  where  II  is  the  word-match  variable  for  the  i-tli  word  and  '/... 

Wi  ij  Wi  ij 

and  Z  arc  the  output  variables  for  the  writing  flip-flop  which  is  a 

cutpoint  cell  of  index  13. 

The  circuit  for  writing  contains  mainly  a  set-reset  flip-flop.  The 

logic  functions  for  setting  V  and  clearing  W  the  writing  flip-flop  are 

s  c 

obviously  the  following: 

W  =  M.  X . ,  (16 

s  Wi  j 

W  -  H,.X..  (17 

c  WI  J 

The  circuit  for  comparison  has  the  output  function  ,  which  is 
the  complement  of  the  bit-match  variable  .  It  follows  from  Fig.  9 
and  Table  A,  that  M  is  given  by  the  equation 

Bij 


.  =  E.(Y.  ©  X.  .), 
bJJ  J  J  ij 


wh.ere  ©  i  s  the  e-clusivc-or  operation.  The  m  j-th  bit-memories  being 
ennhl  v  d  or  m.-v.l  cd  depend  upon  whether  the  binary  variable  E.r0  or  E  =1 
respect  ivt  ly.  The  binary  variable  Y  is  called  tlie  int  cn  ognri  n  var;able, 
which  cobir.cd  with  E  is  employed  to  del  <  r  .iir.c  tlie  three  post  oilities  "0", 
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"1"  and  "tf"  for  an  inlerrogal  ing  cl  i  i  t .  This  situation  is  shown  in 
Table  5. 

The  circuit  for  reading  contains  two  identical  cutpoint  ceils  of 

index  5.  One  of  these  cells  has  the  output  ,  and  the  other  has 

the  output  Mj  Z  . .  When  the  i-th  vord  is  tagged,  M^=l  and  consequently, 

these  two  outputs  are  complementary  to  each  other.  Wien  the.  i-th  word 

is  not  tagged,  11  ~0  and  then  both  outputs  are  zero, 
wi 

3 . 3b .  Ha  t  ch-'i'a  e  1  ’o  twor  k  s 

The  match-tag  network  of  the  i-th  word  is  shown  in  Fig.  9.  It 
performs  the  following  functions: 

1)  It  is  used  as  a  matched-word-i ndicator ,  for  word  i  is  matched 
when  ’ 

t  is  employed  to  set  the  flip-flop  in  tin  sequential  control 

nctwoi  of  the  first  matched  word  i  so  that  T.~l.  This  is  accomplished 

x 

when  II,  =1  under  the  conditions  that  H.  ,=1  and  1.  =1. 

Hi  i-l  l-l 

3)  The  first  matched  word  i  is  tagged  when  M,  .  =  1  and  I.:=l. 

Ml 

A)  The  tagged  word  i  is  automatically  domatchcd  after  Mj,  changes 
from  1  to  0. 

It  follows  from  Fig.  9  that  is  given  by  the  equation 

M»  )l  [E.+(Y.  ©Z.  .)).  (19) 

Hi-  j=1  J  J  iJ 

The  logic  functions  for  setting  II  and  clearing  K  the  tag  flip-flop 

s  o 

are  obviously  th.e  following: 

M  =I.Mt.  (20) 

s  i  Bi 

M  «*  I.  +  *L. .  (23) 

c  l  Bi 

The  bit-match  circuit  of  the  i-th  word  is  shown  ii  Fig.  10.  If 
the  maximum  allowable  fan-in  of  each  culpoinl  cell  is  tv.’J ,  this  network 
can  be.  synthesized  in  a  tree-type  structure  consisting  of  only  the  cut- 
point  cells  of  index  A  as  sv,,~”n  in  Fig.  30(h).  The  stage  delay  of  this 
tree-type  circuit  implemented  by  n  such  cells  is  proportional  to  ^3  og^’i  j 
which  derates  the  smallest  integer  being  not  smaller  than  leg  n. 

3.3c.  Out  nut  Net  works 

The  m  bi  L-w.c mori  os  of  equal  si gn i  f i cai.ce  have  a  pair  or  cr  an 
output  networks  possessing  the  following  two  suwaod  outputs: 
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i 

! 


Table  5. 

Interrogating  Digits  Cor  Bit-Memories  of  Equal  Significance 


E. 

J 

B 

Interrogating  digit 

Remark 

'  "  ' 

0 

— 

0 

0 

Enabled  comparison 

0 

B 

1 

fl 

0 

0 

Masked  comparison 

B 

B 

0 

I 

i  I 


M  "WkV 


3.3d.  Controlled  Shift  Register 

The  controlled  shift  register  consists  of  m-1  sequential  control 
networks  for  words  2  through  m  as  shown  in  Fig.  8.  The  logical  structure 
of  each  sequential  control  network  is  shown  in  Fig.  11.  It  is  noted  that 
there  is  a  switch  with  two  positions  "W"  and  "R".  The  switch  is  normally 
turned  to  position  "W",  and  only  during  the  sensing  or  output-summing 
process,  it  is  turned  to  position  "R". 

After  the  control  current  1^  for  the  first  word  is  on,  the  controlled 
shift  register  is  used  for  turning  on  the  control  currents  I ^  through 
1^  at  the  appropriate  moment  in  order  to  satisfy  the  requirements  of  the 
serial-by-word  tagging  of  all  matched  words.  Each  matched  word  i  is 
tagged  when  I  =1.  The  controlled  shift  register  is  also  used  for  turning 
off  the  control  currents  in  order  to  dematch  all  the  tagged  words. 

The  controlled  shift  register  is  essentially  a  high  speed  shift 
register  associated  with  other  control  circuits.  As  shown  in  Fig.  11, 
each  sequential  control  network  has  three  inputs  I  and 

two  outputs  and  H^.  The  logic  function  for  the  output  current  1^  is 
given  by  the  following  equations: 

h  -  Vi-i-v;-  <24> 

The  symbol  1|  corresponding  to  the  output  terminal  z  of  a  set-reset 
flip-flop  is  the  output  of  the  flip-flop  (the  cutpoint  cell  of  index  13). 

This  flip-flop  is  set  or  cleared  by  I'  or  I’  which  are  given  below: 

J  s  c 

K  *  Hi-iIi-Ai’  (25) 


I*  *=  H  ,  I. 
c  i-1  l-l 

Furthermore,  the  shift  pulse  has  the  following  recursive  property: 

Hi =  Hi-  Ai 


^^(i-lAi 


=  H1MB2MB3 - ^(i-lAi* 

This  recursive  property  is  essential  for  serial-by-word  tag  process, 


From  (M)th 

Sequential  Control  Network 


From  i-th  Word  To  (i»l)th 

Motch-tog  Network  Sequential  Control  Network 

Fig.  11.  The  ith  sequential  control  network  of  controlled 
shift  register. 
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3.4.  OPERATIONAL  PROCEDURES 
3.4a.  Comparison  and  Tag  Processes 

The  comparison  is  a  simultaneous  or  parallel-by-vord  and  parallel- 
by-bit  process.  A  memory  word  which  is  matched  or  mismatched  to  an 
interrogating  word  is  indicated  by  Mg^=l  or  Mg^=0  respectively. 

The  comparison  process  starts  with  applying  the  interrogating  word 
to  the  associative  memory.  The  tag  operation  begins  when  the  sequential 
control  current  1^  is  turned  on.  It  follows  from  Figs.  S  and  10(b)  and 
Table  4  that  the  stage  delay  T  ^  between  the  application  of  the  interro¬ 
gating  word  and  the  indication  of  the  matched  word  $-s  given  by 

the  equation 

vv  v  v  [log2n]  v 

During  the  writing  process,  we  need  the  serial-by-word  tagging, 
which  can  be  accomplished  due  to  the  recursive  property  (27)  of  1L  . 

The  stage  delay  between  the  sh?  ft  pulses  and  1L  ^  is  obviously 
(i-2)T,_.  During  the  sensing  process  of  ordered  retrieval  or  the  output¬ 
summing  process  for  pattern  recognition,  we  require  the  parallel-by-word 
tagging.  This  is  accomplished  by  applying  a  common  control  current  so 
that  the  switch  is  placed  on  position  R  in  each  sequential  control  net¬ 
work.  It  is  obvious  that  there  is  no  stage  delay  for  this  type  of 
tagging.  A  memory  word  which  is  tagged  or  not  tagged  is  indicated  by 
M^=  1  or  »=  0  respectively.  To  terminate  the  comparison  and  tag 
processes,  the  interrogating  digits  and  the  current  1^  are  first  removed. 
Due  to  (24), each  current  1^  is  automatically  turned  off  by  1^  The 
stage  delay  T  between  the  trailing  edges  of  the  current  waves  1^  and 
1^  is  given  by  the  equation 


Tit«(i-1)(T4+  T5). 


(29) 


3.4b.  Writing  Process 

We  first  have  to  locate  all  the  empty  words  before  starting  the 
writing  process.  An  empty  word  in  our  memory  is  a  word  consisting  of 
a  string  of  0's,  and  hence  all  empty  words  can  be  found  by  an  enabled 
comparison  with  a  string  of  n  bits  "0"  as  the  interrogating  word.  If 
there  are  no  empty  words,  we  can  select  the  occupied  words,  which  will 
no  longer  be  used,  by  an  enabled-masked  or  a  masked  comparison. 

The  writing  process  may  be  illustrated  by  the  procedure  of  writing 


**#*£&* 


37 


the  first  two  words  of  r  matched  words.  The  relative  Lime  sequences  of 
various  waves  and  pulses  are  shown  in  Fig.  12.  The  simultaneous  compari¬ 
son  is  first  performed  as  indicated  by  and  Y^.  Through  the  stage 
delay  T  ^ ,  the  matched  words  with  the  positions  k^,  kj+  k^j  •••  are 

indicated  by  =  1»  ^(p  +  fc  )=  1»  *  ••  At  this  instant,  the  control 

^  12  (i) 

current  1^  is  turned  on.  Then,  the  first  shift  pulse  is  applied 

at  the  time  T  after  the  beginning  of  Y..  It  is  seen  from  the  Appen- 
ysl  j 

dix  II  that  T  ^  is  given  by  the  equation 

V  V  t2+  VC"'2+  [loS2n-l  )  V  V  (30: 

The  control  current  I  is  turned  on  by  the  shift  pulse  which 

ki  qn  I 

is  initiated  by  the  first  shift  pulse  H  /.  The  stage  delay  T 

(1)  1  .  Sli 

between  11  and  the  leading  edge  of  I  is 

1  kl 

T  .  =  T  +  k  T  +  T  •  (33.; 

sil  4  15  13 

The  k^-th  word  is  tagged  by  the  control  current  1^  ,  that  is,  M^_ 

is  initiated.  It  follows  from  Fig.  9  that  the  stage  delay  T^  between 

the  leading  edges  of  I  and  M,  is  found  to  be 

kl  Wkl 

T-=T9S+Tin>  (32 

1V7  2,5  13 

where  T  =  Max  (T  ,T  ) .  Then,  the  first  word  to  be  written  in  is 
applied  to  the  associative  memory  through  the  X^,  j=l ,2, . . . ,n,  lines. 

Let  this  word  be  represented  by  .....  x|  ^  ).  The  stage 


delay  T  from  the  beginning  of  the  comparison  process  to  the  pulses 

(i)  yx  . 

Xj  ,  j=l,2,...,n  is  given  by  the  equation  (see  Appendix  II) 

(1) 

T  =  T  +  T  +T  +T 
yx  ysl  sil  iw  w 

■  T1+  T2+  Tj+  <m-l+  [loe2n]  )  1^+  »T5+  T6+  2Tjj+  T2>5. 

After  the  first  word  has  been  written  in  the  k^-th  memory  word, 

changes  from  1  to  0  in  order  to  dematch  word  k..  .  The  stage  delay 

(1)  1 

T  ,  between  the  pulses  X.  ,  j=l,2,...,n,  and  the  trailing  edge  of 

xb  1  j  * 

Mgk  can  be  found  from  Fig.  9.  It  is  given  by  the  equation 


'  V  V  V  V  T13+ 


13+[loS2nl  V  V’ 


'  mm*&  ■  ‘»«T7>  i 


(remain  constant) 


Comparison  period  — 

H? 

-T„ - -fl-'— 


h— Tt" — T.t, — i  hT„ 
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where  T  “  Max  (T  ,  T  ).  Then,  the  tagged  word  is  automatically  dematched 
when  -  0. 

Similarly,  the  second  matched  word  at  the  position  k,+  k  is  tagged 

1  \Z) 

by  the  current  1^  ^  ,  which  is  turned  on  by  the  shift  pulse 

1  2  (2) 

initiated  by  the  second  shift  pulse  ,  Then,  the  second  word 

(X^  X^  . X^)  to  be  written  in  the  tagged  word  at  kn+  k  of  the 

n  n- 1  1  x  z 

memory  can  be  applied  at  an  appropriate  time.  The  procedure  is  the  same 
as  that  for  writing  the  first  word  in  the  first  tagged  word. 

After  all  the  words  are  sequentially  written  in  the  selected  memory 
words,  the  comparison  process  is  terminated  by  removing  the  interrogating 
digits  from  the  lines  Y  and  ,  j=l,2,...,n.  At  the  same  instant,  the 
control  current  1^  vanishes,  and  the  writing  process  terminates.  Then, 
the  next  shift  pulse  H^r+1^ clears  all  previously  set  flip-flops  in  the 
controlled  shift  register.  It  is  shown  in  the  Appendix  II  that  the  time 

(g) 

interval  T  or  T  between  any  two  consecutive  shift  pulses  and 

jj(g+l)  or  any  twQ  CQriseCfct:ive  pulses  X^®'  and  X^®+^  should  be 
T  -  T 

SS  XX 


V  V  (l+  flcVl  >  V0**31  V  V  3Tt3+  T2,5+  T3,4- 


3.4c.  Reading  Process 

The  reading  process  is  performed  on  the  unique-match  and  non-destruc¬ 


tive  basis.  An  enabled-masked  comparison  is  performed  to  select  the  memory 
word  to  be  readout.  Then,  the  unique-matched  word  is  tagged  by  the  method 
as  described  in  the  writing  process.  Suppose  that  the  unique  matched  word 
is  at  the  position  k^  Than  after  the  delay  T^w+  T  since,  the  leading  edge 
of  I,  ,  the  outputs  of  this  tagged  word  are  fed  to  the  output  circuit.  The 

readout  of  this  word  is  terminated  after  the  interrogating  word  is  removec. 

(2) 

and  the  control  current  1^  is  turned  off.  A  second  shift  pulse  is 

used  to  clear  the  flip-flop  in  the.  sequential  control  network  of  the  k^-th 
word. 

During  each  interrogating  cycle  of  ordered  retrieval,  we  first  use  the 
comparison  process  to  select  the  memory  words,  and  then  use  the  parallel- 
by-word  tag  process  for  sensing  the  contents  of  all  tagged  bit-memories 
of  equal  significance.  The  results  of  sensing  as  designated  in  Table  6 
are  employed  to  initiate  the  interrogating  digit  drivers  so  that  an  appro- 


41 

priate  interrogating  word  for  subsequent  comparison  is  generated. 

Each  of  the  matched  words  is  readout  when  a  unique-tag  appears. 

Because  the  sensing  operation  is  accomplished  by  the  parallel-by¬ 
word  tagging,  we  need  only  turn  the  switch  in  each  sequential  control 
network  to  position  "R". 


'  •  *  , 

stgggKS^SSSSj^ in  iaj>r«h»|gwji~i!^ijafar,it>iiTi  ipp<M^piiiia». 


4.  PATTERN  RECOGNITION  BY  USING  AN  ASSOCIATIVE  MEMORY 
4.1.  INTRODUCTION 

During  the  past  three  years,  an  associative  memory  has  been  em¬ 
ployed  in  the  design  of  high-speed  pattern  recognition  machines 
[20,23,25,30].  Estrin  and  Fuller  [20]  have  developed  a  group  of  commands 
executable  in  their  associative  memory  for  pattern  recognition  based  on 
the  extracted  pattern  features  originally  proposed  by  Unger  [35].  Be¬ 
cause  the  programming  for  feature  extraction  and  pattern  classification 
is  always  sequential,  the  speed  for  such  a  pattern  recognition  scheme  is 
limited  by  the  execution  time  of  the  programming.  Simmcns  [23]  has  per¬ 
formed  an  experiment  by  using  an  associative  memory  as  a  pattern  recognizer. 

In  his  experiment,  the  patterns,  which  are  simulated  by  a  random  number 
generator  and  are  recognized  by  a  logical  test,  are  simple  four-element 
mosaic  configurations.  McAteer,  Capobianco  and  Koppel  [25]  have  considered 
the  case,  where  an  input  pattern  is  compared  with  the  stored  words  repre¬ 
senting  the  tolerance  envelopes  for  the  desired  patterns.  Each  input  pattern 
is  required  to  be  normalized,  sampled  and  quantized  at  set  intervals,  and 
then  is  classified  by  performing  a  "between  limits"  search  in  the  associa¬ 
tive  memory.  Fuller  and  Bird  [30]  have  applied  their  scquential-state- 
transformation  method  for  arithmetic  algorithms  in  evaluating  their  thres¬ 
hold  logic  functions  for  their  adaptive  pattern  recognition  scheme. 

The  purpose  of  this  paper  is  to  present  a  pattern-recognition  scheme 
by  using  any  general-purpose  associative  memory,  such  as  one  of  the  systems 
described  in  chapters  2  and  3.  The  input  patterns  for  recognition  may 
have  wide  variations,  provided  that  the  distinct  features  of  individual  pat¬ 
tern  classes  can  be  extracted.  These  extracted  features  are  used  to  determine 
the  prestored  templates  for  all  possible  pattern  classes.  The  proposed 
pattern  recognition  scheme  possesses  the  following  advantages: 

1) .  The  operational  procedure  of  the  scheme  is  simple  because  the  re¬ 
cognition  of  input  patterns  requires  at  most  two  processing  cycles. 

2) .  The  implementation  is  also  simple  since  any  general-purpose  asso¬ 
ciative  memory  can  readily  be  utilized  without  increasing  complexity  in 
hardware. 

3) .  The  operating  speed  for  recognition  is  high  because  of  the  simple 
recognition  procedure  and  the  parallel  operation  of  associative  memory. 

4) . Deviated  patterns  of  the  same  class  can  be  recognized  by  one 

y 
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prestored  template  for  that  pattern  class. 

4.2.  REPRESENTATION  OF  INPUT  PATTERNS 

To  transform  a  pattern  into  the  form  of  a  memory  or  an  initial 
Interrogating  word,  we  project  this  pattern  on  a  screen  which  is 
divided  in  the  form  of  a  matrix  of  order  pyq.  Then,  the  pattern  can 
be  represented  by  a  binary  pyq-tuple 


(all,ai2’ 


Llq’“21 . ’aij . *  %<?> 


(36) 


where  each  a^ ,  i=l,2,  ...  ,  p,  j=l,2,  ...  ,  q,  is  a  binary  variable  being 
either  "0"  or  "1"  based  on  whether  the  cell  at  the  ij  entry  of  the  matrix 
(i-th  row  and  j-th  column)  is  covered  or  not  covered  by  the  pattern  res¬ 
pectively.  We  shall  call  a^  a  black  cell  of  a  pattern  if  it  is  covered 
by  the  pattern,  and  a  white  cell  of  a  pattern  if  it  is  not  covered  by  the 
pattern.  In  other  words,  when  we  project  a  pattern  on  the  screen,  a„  is 
a  black  cell  of  the  pattern  if  a„=0  and  a  white  cell  of  the  pattern  if 
a^=l.  Thus,  we  convert  a  pattern  to  a  memory  word  of  length  px  q. 

When  we  have  a  pattern  to  be  recognized,  a^  through  »  of  the 

pyq-tuple  of  the  pattern  are  used  to  initiate  the  interrogating  digit 

drivers  of  an  associate  memory  to  generate  an  interrogating  word  for  the 

initial  comparison  process.  When  a„=0,  the  corresponding  interrogating 

digit  is  also  0.  When  a.  .=1,  the  corresponding  interrogating  digit  is  0 

— •  J 

which  denotes  the  "don't-care"  digit. 

Before  the  p y q-tuple  of  an  input  pattern  is  used  for  recognition, 
the  position  of  the  input  pattern  is  adjusted  so  that  at  least  a  black 
cell  appears  in  the  p-th  (bottom)  row  and  at  least  a  black  cell  appears 
in  the  first  (left)  column.  This  position  is  called  the  standard  posi¬ 
tion.  We  can  see  that  this  condition  is  easily  satisfied  for  each  input 
pattern. 

4.3.  DETERMI NATION  OF  TEMPLATES  OF  PATTERN  CLASSES 


The  template  including  all  possible  acceptable  deviated  patterns 

in  a  class  h^,  which  is  stored  in  the  associative  memory  as  a  memory 

word  can  be  determined  as  follows:  We  first  find  the  intersection  [36] 

of  the  set  of  the  white  cells  of  all  possibly  acceptable  deviated  patterns 

of  Class  h,.  This  intersection,  denoted  by  F,  ,  is  a  set  of  white  cells 
l  h. 

representing  the  features  of  the  patterns  of  class  h^  and  is  invariant 
for  all  possibly  acceptable  patterns  of  Class  Ik.  In  the  memory-word 


for  Cla_  h  ,  the  information  stored  in  the  corresponding  bit-memories 

for  these  white  cells  is  all  "l",  and  the  corresponding  bit-memories 

for  the  remaining  cells  is  all  "0".  Thus,  the  template  of  Class  Ik 

which  is  constituted  by  and  its  complement,  denoted  by  ,  is 

stored  in  a  memory-word  consisting  of  l's  and  0's.  L 

It  is  noted  that  die  set  is  actually  the  union  [36]  of  the  sets 

of  the  black  cells  of  all  possibly  deviated  patterns  of  Class  h^.  When 

the  degree  of  deviation  of  the  patterns  in -Class  Ik  increases,  the  set 

F  becomes  smaller  and  B  appears  larger.  Therefore,  the  set  F,  not 
n.  h.  n. 

only  represents  the  features  of  the  patterns  in  Class  Ik,  but  also1deter- 
mines  the  degree  of  allowable  deviation  of  the  patterns  in  Class  Ik.  In 
the  associative  memory,  the  bits  "1“  corresponding  to  the  celln  in  F^ 
represent  the  identifier  of  the  stored  word  corresponding  to  the  template 
of  Class  h. • 

l 

The  templates  of  other  pattern  classes  can  be  determined  by  the  same 
method.  Because  each  pattern  class  is  different  from  all  other  pattern 
classes,  the  sets  F  ,  F  ,  ...  ,  F  are  all  distinct.  However,  in  order 
to  allow  a  large  degree  or  deviations  of  the  acceptable  patterns  in  each 
pattern  class  and  to  avoid  misclassif ication  of  patterns,  the  sets  F  , 

l 

Fh  »  • « •  ,  have  to  be  adjusted  with  respect  to  each  other.  To 

illustrate  this  situation,  the  templates  of  all  the  capital  English 

letters  and  the  numerals  may  be  proposed  as  shown  in  Fig.  13,  in  which 

each  template  is  represented  by  an  8  X  8  matrix.  The  shaded  and  non-shaded 

regions  of  each  template  h.  represent  F,  and  B,  respectively.  Each  of 

l  h .  h . 

these  templates  is  stored  in  a  memory  word,  in  winch  the  extremely  right 
bit-memory  and  the  extremely  left  bit-memory  store  the  information  corres¬ 
ponding  to  the  template  cells  a.,  and  a  respectively.  In  order  to  faci- 

11  pq 

litate  the  explanation,  the  determination  of  the  templates  will  be  dis¬ 
cussed  in  further  detail  after  the  recognition  scheme  is  presented  in 
the  next  section. 

4.4.  RECOGNITION  SCHEME 

Suppose  that  the  template  of  each  class  has  been  stored  in  the  asso¬ 
ciative  memory  as  described  before.  The  procedure  for  our  recognition 
scheme  is  given  below: 

1),  After  the  input  pattern  is  placed  in  the  standard  position,  a 
string  of  binary  signals  of  the  pxq* tuple  of  the  input  pattern  is  applied 


Pre-storcd  templates  for  rec 
capital  English  characters  a 
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to  the  interrogating  digit  drivers.  These  drivers  are  initiated  by  the 
input  signals  and  generate  the  interrogating  word  for  the  initial  com¬ 
parison.  As  described  before,  the  output  of  the  driver  is  "0"  or  ''0" 
when  its  input  signal  is  "0"  or  "1”  respectively.  Therefore,  the  initial 
cycle  of  recognition  involves  an  enabled -masked  comparison  unless  all  the 
cells  of  the  input  pattern  are  black.  If  no  matching  is  indicated,  then 
the  input  pattern  belongs  to  the  rejection  class,  i.e.,  the  input  pattern 
does  not  belong  tc  my  of  the  pattern  classes  we  want  to  classify.  If  a 
unique  matching  is  indicated,  the  input  pattern  belongs  to  the  class  of 
the  matched  template.  In  both  cases,  the  recognition  process  for  this  in¬ 
put  pattern  is  completed.  However,  if  a  multiple  matching  occurs,  follow 
the  next  step. 

2).  Whenever  a  multiple  matching  appears,  an  output-summing  opera¬ 
tion  for  all  matched  and  also  tagged  memory  words  follows.  The  summed 
output  signals  of  equal  significant  bit-columns  of  the  associative  memory 
are  used  to  activate  the  interrogating  digit  drivers  to  produce  another 
interrogating  word  for  second  comparison.  The  new  interrogating  digit  is 
"0"  or  "l"  when  the  corresponding  summed  output  signal  is  "0"  or  "1" 
respectively.  After  the  new  interrogating  word  is  generated,  the  second 
enabled  comparison  is  performed.  If  a  unique  match  occurs  at  this  time, 
the  matched  template  indicates  the  class  of  the  input  pattern.  Otherwise, 
the  input  pattern  belongs  to  the  rejection  class.  The  recognition  process 
is  then  completed. 

It  is  noted  that  multiple  matching  never  occurs  in  the  second  cycle 
because  the  comparison  is  an  enabled  comparison  process  whose  interroga¬ 
ting  word  contains  no  "don' t-case"  bits,  and  because  the  stored  templates 
of  the  pattern  classes  are  all  distinct.  Hence,  the  recognition  process 
for  each  input  pattern  requires  no  more  than  two  cycles. 

To  demonstrate  this  technique,  let  us  consider  the  case  of  recogni¬ 
zing  hand-written  block  capital  English  letters  and  the  numerals.  The 
templates  for  these  35  pattern  classes  are  shown  in  Fig.  13  and  the  in¬ 
formation  of  these  35  templates  are  assumed  to  be  stored  in  the  associa¬ 
tive  memory  as  described  in  the  last  section.  Suppose  that  the  pattern 
shown  in  Fig.  14(a)  is  the  input  pattern  to  be  recognized.  Then,  we  ob¬ 
tain  the  initial  interrogating  digits  according  to  this  input  pattern  as 
shown  in  Fig.  14(b).  Since  the  bit-columns  of  the  associative  memory 
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Fig.  14.  (a)  An  input  pattern  to  be  recognized,  (b)  the  initial 

interrogating  digits  for  the  input  pattern  shown  in  (a), 
and  (c)  the  summed  outputs  of  the  tagged  templates  (for 
Classes  B,  E,  F,  P  and  R)  for  the  input  pattern  shown  in  (a)  . 
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which  are  interrogated  by  the  "don't-care"  digits  "0"  are  all  masked  out, 
the  stored  templates  of  Claeses  B,  E,  F,  P  and  R  are  all  matched.  All 
these  matched  memory  words  are  tagged.  The  contents  of  the  tagged  bit- 
memories  of  the  equal  significant  bit-position  are  summed  together  by  an 
output  network.  The  summed  outputs  which  are  the  Boolean  sums  obtained 
by  these  output  networks  are  shown  in  Fig.  14  (c) ,  According  to  our 
procedure,  we  need  the  second  cycle  for  recognizing  the  input  pattern. 

The  new  interrogating  digits  for  the  comparison  in  the  second  cycle  are 
the  same  as  shown  in  Fig.  14(c).  Because  the  distribution  of  the  0's 
and  l's  of  the  new  interrogating  word  is  identical  to  that  of  the  pre¬ 
stored  template  for  Class  F shown  in  Fig.  13,  the  input  pattern  shown  in 
Fig. 14(a) is  therefore  recognized  as  F  due  to  the  unique  match  in  the  se¬ 
cond  comparison  process. 

From  this  example,  it  is  easily  seen  that  an  input  pattern  is  re¬ 
cognized  as  a  pattern  of  Class  h  due  to  a  unique  match  during  the  second 

i 

comparison  process  if  and  only  if  the  set  F^  of  the  uniquely  matched  tem¬ 
plate  of  Class  lu  contains  the  set  of  white  cells  of  each  multiple  matched 
template,  as  a  proper  subset  during  the  initial  comparison  process.  From 
the  templates  of  Classes  B,E,  F,  P  and  R  shown  in  Fig.  13,  we  can  see  that 


PF3PE3PB  ’ 

(37) 

and 

V^P^R  * 

(38) 

If  we  change  the  cell  ac  D  of  the  template  of  Class  F  in  Fig.  13  from  white 

->  ,o 

to  black  as  shown  in  Fig.  15,  then  the  relation  (38)  no  longer  holds  because 
the  set  F  in  the  alternate  template  does  not  contain  F  in  Fig.  13  as  a 

r  r 

proper  subset.  Should  this  alternate  template  be  used  for  Class  F,  there 

would  be  no  matching  at  all  during  the  second  comparison. 

Suppose  that  we  have  the  input  pattern  shown  in  Fig.  16(a).  Then, 
the  set  of  black  cells  of  this  input  pattern  is  contained  in  the  intersec¬ 
tion  B  HB  HB  nB„nB  HB  nEj-riB,,.  The  reader  may  verify  that  this  input 
BEFHMrRW 

pattern  will  be  classified  in  the  rejection  class  according  to  our  technique 

unless  an  additional  template  sho\m  in  Fig.  16(b)  is  stored  in  the  memory. 

4.5.  FURTHER  CONSIDERATION  IN  THE  DETERMINATION  OF  TEMPLATES  OF 

PATTERN  CLASSES 

After  the  template  of  each  pattern  class  is  taken  according  to  the 
intersection  of  the  sets  of  white  cells  of  all  possibly  acceptable  deviated 
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patterns  of  the  class,  an  adjustment  is  required  among  the  templates  of 

several  pattern  classes  if  the  intersection  of  the  sets  of  black  cells  of 

these  templates  contains  the  net  of  birr  k  cells  of  an  acceptable  pattern 

in  one  of  these  classes.  For  instance,  the  intersection  of  B  ,  B  ,  B  B 

15  r  1 

and  B  of  the  unadjusted  templates  for  Classes  B,  E.  F,  P  and  R  may  contain 
K 

an  acceptable  pattern  of  Class  F.  In  order  to  identify  this  acceptable 

pattern  of  Class  F,  we  have  to  reduce  the  set  B  unti i  B  is  equal  to  the 

r  r 

intersection.  That  is, 

BF=BBnVBFnBPnV  (39) 

Of  course,  this  reduction  may  reject  some  other  acceptable  patterns  of 
Class  F,  and  hence  uc  have  to  compromise  these  considerations  in  the  de¬ 
sign  of  the  templates.  For  instance,  if  we  want  Lo  classify  the  pattern 
shown  in  Fig.  17(a)  in  Class  F,  the  B  in  the  template  of  Class  F  has  to 
be  reduced  until 

BF  =  BBn  BEn  BFri  Bpn  BrD  (40) 

because  the  set  of  black  cells  of  the  patte*..'  shown  in  Fig.  17(a)  is 
contained  in  that  of  the  template  for  Class  6.  The  reduced  template  for 
Class  F  is  shown  in  Fig.  17(b).  However,  this  reduced  template  should 
not  be  used  for  Class  F  because  many  patterns  of  Class  F,  such  as  the  one 
shown  in  Fig. 14(a)  will  be  rejected.  Thus,  we  have  to  decide  whether  we 
want  to  accept  the  pattern  in  Fig.  17(a)  in  Class  F  at  Lhe  expense  of  re¬ 
jecting  many  other  acceptable  Class  F  patterns.  It  is  noted  that  if  Class 
6  were  not  one  of  the  pattern  classes  wo  want  to  classify,  then  the  patterns 
shown  in  both  Fig.  14(a)  and  17(a)  would  be  accepted  as  Class  F  patterns  by 
using  the  templates  shown  in  Fig.  13. 

The  relations  among  the  sets  of  black  cells  in  the  templates  of  var¬ 
ious  pattern  classes  can  also  he  expressed  in  terms  of  their  sets  of  white 
cells.  In  order  to  classify  all  the  20  capital  English  letters  and  the  10 
numerals  with  large  allowable  deviations,  some  relations  among  the  sees  of 
white  cells  in  the  templates  of  these  35  pattern  classes  arc  required. 

These  relations  are  listed  in  Table  7.  It  is  seen  that  Lhe  templates 
shown  in  Fig.  13  satisfy  all  these  relations. 

4.6.  IMPLEMENTATION 

The  requirements  for  an  associative  memory  to  perform  our  recognition 
scheme  are  listed  below: 


is 
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1) ,  It  is  non-destructive  read-out. 

2) ,  It  is  word-organized  and  can  perform  the  masked  comparison 
and  the  output -summing  operation  for  all  tagged  bit-memories. 

It  is  obvious  that  these  two  requirements  do  not  impose  any  diffi¬ 
culty  on  ordinary  associative  memory  systems.  Without  any  modification, 
the  cryogenic  associative  memory  or  the  cutpoint  cellular  associative 
memory  is  well  suited  for  this  purpose. 

To  see  how  the  cutpoint  cellular  associative  memory  perform  this  re¬ 
cognition  scheme,  let  us  refer  to  Fig.  8.  All  bit-memories  lj  through 
mj  of  the  same  j-th  significant  bit  position  can  be  enabled  or  masked 
out  by  setting  the  value  of  E^  being  0  or  1  respectively.  The  interro¬ 
gating  digit  for  each  column  j  is  designated  by  the  binary  values  of 

and  Yj  as  shown  in  Table  5.  Let  n  -  pq.  Then,  X^  through  X^  are  the  in¬ 
put  variables  for  writing  the  components  a,,  through  a  of  each  template 

11  pq 

in  a  tagged  memory  word.  The  summed  output  Z,„  of  the  j-th  column  is  de- 

Ja 

rived  by  the  right  j-th  output  network  as  shown  in  Fig.  8,  and  is  express¬ 
ed  by  (22). 

4.7.  FURTHER  CONSIDERATION  OF  RECOGNITION  SCHEME 


In  each  pattern  class  determined  by  the  pre-stored  template,  many 
deviated  patterns  can  be  recognized.  For  instance,  each  of  the  input 
patterns  as  drawn  by  smaller  scale  and  shown  in  Fig,  18  is  recognized 
as  F  in  two  cycles.  The  deviation  involves  size,  style,  and  orientation 
within  certain  limits,  provided  that  the  set  of  black  cells  of  an  input 
pattern  is  contained  in  of  the  pre-stored  template  for  Class  F.  The 
degree  of  deviation,  and  possible  mis-classification  between  B  and  8  or 
S  and  5  depend  on  the  relative  white  components  of  the  pre-determined 
templates  stored  in  the  memory.  The  following  possible  methods  may  be 
used  for  optimizing  the  degree  of  deviations,  minimizing  the  number  of 
mis-classification  between  similar  characters  of  different  classes: 

1).  The  number  of  cells  for  each  pattern  can  be  increased  to  256  or 
even  1024  which  corresponds  to  p  =  q  =  16  or  32  respectively.  An  asso¬ 
ciative  memory  possessing  1024  bits  per  word  is  possible  [29].  However, 
when  the  number  n  of  bit-memories  per  word  is  increased,  the  stage  delay 
during  comparison  increases  because  it  is  proportional  to  £log2nJby  using 
the  cutpoint  cellular  associative  memory.  When  p  and  q  are  increased, 

each  curved  boundary  between  the  sets  F^  and  B^  of  the  template  for 

ni  ni 
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Class  can  be  made  smoother  and  the  determination  and  adjustment  of  the 
set  F  become  easier  because  of  the  increased  flexibility  due  to  a  larger 
set  F^  .  Furthermore,  the  deviations  of  the  pattern  classes  can  also  be 
increased  by  increasing  the  number  of  cells  in  the  matrix. 

2).  The  template  of  a  certain  class  may  be  supplemented  by  another 
slightly  different  template,  which  possesses  a  larger  set  of  white  cells. 
For  example,  the  template  for  Class  F  of  Fig.  13  can  be  supplemented  by 
that  of  Fig.  17(b)  to  increase  the  acceptable  deviation  of  Class  F. 


5.  TWO- SUMMAND  ADDITION  BY  AN  ASSOCIATIVE  PROCESSING  SYSTEM 
5.1.  INTRODUCTION 


The  early  work  concerning  the  applications  of  an  associative  memory 
was  nearly  confined  to  the  area  of  information  storage  and  retrieval. 

Since  1963,  arithmetic  algorithms  processed  in  an  associative  memory  have 
been  considered  by  Estrin  and  Fuller  [14],  and  many  others  [16,26,27,30]. 
Their  algorithms  are  all  based  on  software  approach  and  most  of  them  are 
processed  in  serial-by-bit  manner.  Although,  Crane  and  Githens  [27]  have 
suggested  the  bulk  processing  technique  being  capable  of  performing  arith¬ 
metic  operations  on  the  parallel-by-word  and  parallel-by-bit  basis,  their 
content-addressible  memory  derived  from  the  distributed  logic  machine  [18] 
needs  to  be  bit-organized  and  their  scheme  may  require  large  storage  capa¬ 
city  for  bulk  processing. 

The  purpose  of  this  chaptei  is  to  present  a  nonbulk  two -summand  addi¬ 
tion  method  by  utilizing  the  sensing  process  of  a  word-organized  associa¬ 
tive  memory.  Parallel  arithmetic  operations  can  be  achieved  by  paying  a 
limited  price  for  the  additional  implementation  besides  the  associative 
memory.  However,  the  distributed  logic  circuit  of  a  word-organized  associa¬ 
tive  memory  may  be  simpler  than  that  of  a  bit-organized  content-addressible 
memory,  for  example,  each  bit-memory  of  the  former  system  does  not  require 
communicating  with  its  two  nearest  neighbors. 

In  this  chapter,  we  shall  define  a  state  symbol  for  each  possible 
summand  digit-pair  so  that  the  state  form  of  each  particular  summand-pair 
can  be  developed.  This  concept  will  then  be  extended  to  establish  sets 
of  algebraic  equations  which  characterize  exactly  all  possible  allowable 
addition  processes  (without  overflow)  and  all  possible  unallowable  addition 
processes  (with  overflow)  for  n-bit  signed  numbers.  These  numbers  are  re¬ 
presented  by  the  2* s -complement  notation.  Thus  a  Mealy  type  sequential 
machine  can  be  synthesized  for  transforming  the  state  representation  of 
each  summand-pair  to  its  corresponding  sum.  This  state  representation 
which  constitutes  the  input  of  the  sequential  machine  is  readily  obtained 
by  a  sensing  process  of  an  associative  memory. 

5.2.  STATE  REPRESENTATION 

5.2a.  State.  Representation  of  Summand  Digit-Pair 

When  two  n-bit  signed  numbers  are  added,  each  summand  digit-pair 
(A ^ ,  B^)  may  possess  one  of  the  following  four  possible  values: 
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(0,  0),  (1,  1),  (1,  0)  and  (0,  1), 
which  can  be  represented  respectively  by  the  symbols  G^,  G^,  P^  and 
where  the  subscripts  0  and  1  denote  the  binary  values  of  die  addend 
digit  Bj.  This  type  of  representation  is  called  the  state  representation 
of  the  summand  dieit-pair. 

5.2b.  State  Representation  of  Summand-Pair 

By  using  the  state  symbols  G^,  G^,  P^  and  P^,  the  two  n-bit  signed 
numbers  being  added  can  be  expressed  uniquely  by  n  such  symbols.  The 
extremely  left  position  of  the  state  representation  of  two  summands  is 
determined  by  the  sign  digit-pair  (A^,  B^)  in  which  the  ordinary  conven¬ 
tion  0  or  1  is  used  for  denoting  the  positive  or  negative  sign  respectively. 
The  state  representation  of  the  remaining  n-1  magnitude  bit  positions  of 
the  given  summand-pair  is  based  on  the  2* s -complement  number  system. 

5.2c,  Classes  of  Summand 

To  simplify  description,  the  signed  summands  are  divided  into  three 
classes  which  are  distinguished  by  the  class  number  u,  u=l,  2  and  3.  We 
define  Class  1  or  2  summands  as  both  positive  or  both  negative  binary 
numbers  respectively.  Class  3  summands  denote  the  two  binary  numbers  with 
opposite  signs. 

5 . 2d .  Allowable  and  Unallowable  Addition  Processes 

VJlien  we  consider  the  addition  of  two  n-bit  signed  numbers,  there  are 
4°  different  cases  because  each  digit  position  may  have  four  possible 
state  forms.  For  Class  1  or  2  summands,  some  of  the  4n  possible  addition 
processes  should  be  excluded  because  of  overflow.  Overflow  occurs  whenever 
the  absolute  value  of  the  sum  exceeds  2n  ^  for  n-bit  summands.  The  allow¬ 
able  or  unallowable  addition  processes  are  defined  as  those  additions  with¬ 
out  or  with  overflow  respectively. 

5.2e.  State  Representations  of  Allowable  Addition  Processes 

The  state  form  for  the  sign  digit-pair  (A^,  B^)  of  each  addition 
process  must  be  one  of  the  four  symbols  G^,  G^,  P^  and  P^.  The  state 
representation  of  the  n-1  digit-pairs  (A^,  B^)  through  (A^ B^_^)  corres¬ 
ponding  to  the  magnitudes  of  the  two  summands  must  be  one  of  the  permutation 
of  n-1  objects  selected  from  four  different  sets  of  elements,  each  of  which 
consists  of  n-1  alike  state  symbols  being  G^,  G^,  P^  and  P^.  In  order  to 
show  the  state  representation  of  all  possible  allowable  addition  processes, 
we  define  the  following  two  operations  among  the  state  symbols  G^,  G^,  P^ 


and  P^.  "+"  is  the  same  as  addition .  which  is  associative  and  commuta¬ 


tive. 


means  concatenation  which  is  associative  but  not  commutative. 


The  notation  "*M  for  concatenation  is  usually  omitted  in  the  state  repre¬ 
sentation  of  addition  processes.  For  example,  G^*  is  usually  written 
as  G^G^.  Furthermore,  the  concatenation  of  i  identical  state  forms  is 
usually  writen  as  the  i-th  power  of  that  state  form.  These  two  operations 
satisfy  the  following  distributive  law: 

Grt(G  +P  )  =  G  G,+G  P 

0  1  0  0  1  0  0  ( L 

Suppose  that  the  number  10 . 0  with  n-1  consecutive  zeros  is  also 

interpreted  as  the  negative  number -2n  The  state  representation  S^(n) 

of  all  allowable  addition  processes  for  Class  1  n-bit  summands  may  be 
written  as 


si<”>  -  WV 


ViV 


z  WV1  yp.+p.+c.M,)'1'1"2  (42) 

i_0  ,  i 

where  the  zero-th  power  of  an  expression  is  always  1  and  the  negative  power 
of  an  expression  is  always  0.  The  Symbols  "l"  and  "0"  act  as  identity  and 
nullity  elements,  i.e.,  G^* 1=  1*Gq=Gq,  Gg»0=0-Gg=0,  and  Gq+0=Gq .  Thus, 
it  is  easily  seen  that  (42)  is  a  collection  of  2  2+  2^n  ^  concatenations 

each  having  exactly  n  state  symbols. 

When  n=2,  (42)  reduces  to  the  following  form: 

sx(2)  *  g0(pq+p1-k;0).  (43) 

This  equation  denotes  that  the  three  allowable  addition  processes  for 
2-bit  positive  summands  are  characterized  by  the  three  state  representa- 
tions  GQP0,  GqP1  and  G*  . 

For  the  2's-complement  number  system,  the  state  representations 
S^(n)  through  S^(n)  of  all  possible  allowable  addition  processes  are  listed 
in  Table  8.  Since  the  2*s-complement  notation  possesses  the  same  represen¬ 
tation  for  positive  and  negative  zeros  and  also  the  end-around  carries  can 
be  simply  ignored,  we  shall  consider  only  this  number  system  in  this  chapter. 
5.2f.  State  Representation  of  Unallowable  Addition  Processes 

For  Classes  1  and  2  summands,  an  addition  process  characterized  by 
one  of  the  following  state  representations 


Table  8 


State  Representations  of  Allowable  Addition  Processes 


Classes  of 
summands 


State  representations 
S  (n) 


V">-  VWn‘2<W?0)  +  £  VWVo^VVV”'1'2 


S2(n).  0^1(P0+P1)n-2G1  +P0<P0«0)r"1+P1(P1«0)n-1+ 

V  0^?/  G1(P0+P1«0«1)n-1-2 


S3(n)=  °0(P0'W;0)n'1'H;0<Pl-H:0)n'l+Pl(P0+PlHG0'K!l>n'1+ 


VWW 
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1) .  G0(PQ+P1)iG1...,  i  5  0 

2) .  Gi<P0+Pi>n"1 > 

3) .  G1(P0+P1)iGQ... ,  i*0 

is  unallowable  because  of  overflow.  The  state  representations  U^(n)  and 

^(n)  of  all  possible  unallowable  addition  processes  are  shown  in  Table  9. 

5.2g.  State  Representations  of  Merged  Addition  Processes 

If  the  state  symbol  of  the  summand  digit-pair  (A  B  )  is  G.  or  G  , 

J »  j  0  1 

then  a  zero  or  non-zero  carry  is  generated  respectively;  and  a  zero  sum 
digit  is  produced  in  both  cases.  Thus  the  state  symbols  G^  and  G^  must 
be  differentiated  because  of  the  different  generated  carries.  If  the 
state  symbol  of  Pq  or  then  a  zero  carry  and  a  sum  digit 

"1"  are  generated  in  both  cases.  Therefore,  the  state  symbols  P^  and  P^ 
shall  not  be  differentiated  and  can  be  merged  by  the  symbol  P.  The  state 
representations  S(n)  and  U(n)  of  the  merged  allowable  and  unallowable  addi¬ 
tion  processes  for  all  classes  of  summands  are  shown  in  Table  10. 

5.3.  ORGANIZATION  OF  ASSOCIATIVE  PROCESSOR  FOR  ARITHMETIC  OPERATION 

The  proposed  system  for  our  addiMon  technique  is  shown  in  Fig.  19. 

It  consists  of  an  associative  memory,  a  pair  of  shift  registers  and  a 
six-state  sequential  machine  which  are  introduced  in  the  following  sections 
separately. 

5.3a.  Associative  Memory 

Any  associative  memory  possessing  a  double-sense  line  with  outputs 
and  Z ^  at  each  bit  position  j  can  be  employed  in  the  system  for  arith¬ 
metic  processing.  In  Fig.  19,  the  outputs  Z  and  Z  ,  of  the  memory  are 

ja  jb 

used  for  obtaining  the  sensing  results  as  designated  in  Table  6.  When  the 
number  of  tagged  words  during  a  sensing  process  is  exactly  two,  the  "sense  0", 
"sense  1"  or  "sense  X"have  identical  bit-content  with  the  state  symbols 
Gq,  G1  or  P  respectively.  Thus,  we  can  utilize  a  sensing  process  in  obtain¬ 
ing  the  state  representations  of  the  n  digit-pairs  if  the  number  of  tagged 
words  is  exactly  two.  In  this  case,  the  state  representation  of  each 
summand  digit-pair  generated  by  a  sensing  process  is  actually  denoted  by 
a  coded  form  as  designated  in  Table  6. 

5.3b.  Shift  Registers 

Although  the  sensing  results  of  the  n  bit-positions  are  generated 
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Table  9. 


State  Representations  of  Unallowable  Addition  Processes 


Classes  of 
summands 

u 

State  representations 

1 

V">"  VWn'V”=’ 

2 

U2(n)-  c1(P0+Pi>”‘2Cr0+Pi'K!0)+1^0  VVVVVW/'1'2 

3 

Does  not  exist. 

Table  10. 

State  Representations  of  Merged  Addition  Processes 


3 

Allowable 

S (n)=  E  S  (n)=  2n'2G  Pn“2(2P-KJ  )4CjJ+2n~2G1Pn“2G1+ 

cases 

i«l  1 

1 

1 

P  (P+GQ)n~  1+2nG()  (P+G0)n"  *+2P  (2P+GQ+G1)n“  *+ 

V  2l  [(G0PiG0-KJ1PiG1)  (2P+G0+G1)n'1"2] 

Unallowable 

2 

U(n)=  E  U  (n)=  2n"2G  Pn_2G1+2n_2G1Pn"2(2P-4G0)+ 

cases 

1 

T1  3 

E  2(G  P^G  +G  P1G  )  (2P4G  +G  J11”1”2 
i=0  w  i  X  u 
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Fig.  x9.  An  associative  processor  for  arithmetic  processing. 
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simultaneously,  a  pair  of  right  shift  registers  is  required  for  storing 
the  sensing  results,  which  then  become  the  inputs  to  the  sequential 
machine.  As  shown  in  Fig.  19,  the  shift  registers  a  and  b  are  employed 
to  store  the  memory  outputs  Z ^  and  Z^  for  j=l,2,...,n  respectively, 
and  the  outputs  Z^a  and  Z^  of  the  shift  registers  a  and  b  feed  the  se¬ 
quential  machine  as  its  inputs.  The  shift  registers  and  the  sequential 
machine  should  be  operated  synchronously. 

5.3c.  Sequential  Machine 

The  sequential  machine  which  is  a  Mealy  type  machine  is  used  for 
transforming  the  coded  state  representation  of  each  summand-pair  to  the 
final  sum  of  that  summand-pair.  This  machine  possesses  the  input  alphabet 
,  the  output  alphabet  <^=[0,1, e, 0^} ,  and  the  state  set 
a  *={sn,s. , . . . . ,  s,.},  where  is  a  marker  symbol  [37]  indicating  the  be- 

S  U  i  j 

ginning  and  end  of  an  input  string,  "e"  indicates  a  null  output,  and  "O^" 
denotes  an  overflow  addition  process.  Since  the  direction  of  carry  propa¬ 
gation  is  from  the  right  to  the  left,  both  right  and  left  end  markers 
denote  the  starting  and  terminating  positions  during  transformation.  In 
order  to  accommodate  with  the  end  markers  and  the  n  coded  state  symbols, 
there  should  be  n+2  flip-flops  in  each  shift  register. 

5.4.  SYNTHESIS  OF  SEQUENTIAL  MACHINE 

5.4a.  Machine  A  Synthesized  From  State  Representations 

Since  different  summand-pairs  may  have  identical  final  sum  when  these 
summand-pairs  have  the  same  state  representation,  the  redundancies  contain¬ 
ed  in  S(n)  and  U(n)  as  shown  in  Table  10  can  be  deleted  by  using  the 
following  relationships: 


n-3  ,  0 

Gq  C  £  GoP1G0(P-K30-K;i)n'W 


P(P-K50)n_1C  P(P+G()-K;i)n“1 


Then,  the  distinct  state  representations  S  (n)  and  U  (n)  of  merged  addition 
processes  for  both  allowable  and  unallowable  cases  are  shown  in  Table  11. 

A  set  of  rules  for  transforming  the  input  coded  state  symbols  to  the 
output  sum  digits  can  be  depicted  by  the  diagram  shown  in  Fig.  20  in  which 


ii  mrw 


BWMSWllJn 


Allowable 

S*(n)=  G()Pn"2(P+G0)+G1Pn'2G1  +  PCP-K^-K^)""1* 

case 

r\  3 

\  C(G0P1G0+G1P1G1)  (P+G^j)""1"2] 

Unallowable 

U*(n)=  G()Pn"2G1-lG1Pn"2(P+G0)  + 

case 

V  [(GQPiG1-K;iP1G0)(P+G04G1)n'i"2] 
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the  weight  represents  the  input-output  string-pair, 
possible  input-output  string-pair  may  be 

GV  °n> 

pn/  ln, 


When  i^=n,  the 


or 


0 "/  in-1o 


which  is  the  weight  of  the  directed  branch  (n^n^),  ^na,nc^  or  ^na,nd^ 
respectively.  Similarly,  when  i^+  n,  the  possible  input-output 
string-pair  consisting  of  two  distinct  types  of  state  symbols,  may  be 


or 


l2  S  *2  ‘l 

p  a0l  /  i  o  \ 

in  i,  i  -1  i,+l 

Gi2  Go1  /  1  2  0  1  * 

G*2  P1”1  /  0l2  1  1 

io  X1  ^"2""^  ^1 

G1/  P  /  1  01, 

i?  *1  V1  i1 

G0Z  GxX  /  0  1  1  0, 

*2  *1  *2  *l”*' 

P  1  G^  /  0  1  1  1  0 


a'  e-  '  -  a'  £'  '  '  a'  g 
Since  the  input-output  string - 


which  is  the  weight  of  the  directed  branch  (na,iO,  (na»nf)>  (n^ja^), 

(n  ,a),  (n  ,n.)  or  (n  ,n  )  respectively. 
a  “  i  a  j_x  ia  J  i  -1 

pairs  Gq3  /  0  3  and  G^3  /  1  3  0  which  appear  as  the  weights  of  the  dotted 

directed  branches  (n  ,n  )  and  (n  ,n  )  are  identical  with  those  string- 

e  n  a  p 

pairs  which  are  the  weights  of  the  directed  branches  (nc>ng)  and  N^n^) 

respectively  when  i^—  ij*  the  node  n^  is  equivalent  to  n^  and  those  dotted 

directed  branches  can  be  omitted  in  the  diagram.  By  the  same  token,  the 

nodes  of  n  ,  n  ,  and  n  are  equivalent  to  n,  and  the  nodes  n  ,  n  and  n, 
f  h  m  d  g  1  K 

to  n^.  Hence,  the  diagram  may  terminate  at  the  nodes  n^}  n^,  n^,  n^,  n^, 

n  and  n  .  The  direction  of  each  branch  shows  the  direction  of  carry  pro- 
k  m 

pagation. 

The  state  graph  of  sequential  machine  A  can  be  easily  realized  based 

•k  * 

on  the  transformation  rules  and  the  state  representations  S  (n)  and  U  (n) 
by  setting  the  value  of  n  up  to  5.  Wien  n  -  6  we  have  found  that  the  state 
graph  of  the  sequential  machine  is  identical  with  the  one  for  n=5. 


*A  directed  branch  of  the  state  graph  is  denoted  by  the  ordered-pair 
(ni,n^)  where  n.  a; 
node  respectively. 


(rujn  )  where  n.  and  n.  represent  the  starting  node  and  the  termination 


I 
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The  minimal  state  graph  of  machine  A  is  shown  in  Fig.  21,  where  s^  is 
the  beginning  and  end  state.  When  machine  A  transits  to  the  state 
or  s^,  a  zero  carry  is  produced.  Wien  machine  A  transits  to  the  state 
82  or  s^,  a  nonzero  carry  is  generated. 

5.4b.  Pis  joined  Sequential  Machine 

Since  the  state-transition  of  machine  A  is  sequential,  the  opera¬ 
ting  speed  is  limited  by  the  serial-by-bit  operation.  This  can  be  im¬ 
proved  by  grouping  the  n  summand  digit-pairs  into  two  or  more  sections 
I  ,  with  approximately  the  same  number  of  digits.  If  two  sections  are  used, 

I 

I  the  section  on  the  left-hand  side  consists  of  two  machines  A  and  B  whose 

\  inputs  are  parallelly  connected  and  the  section  on  the  right-hand  side 

i  has  only  one  machine  A'.  The  state  graph  of  machine  B  shown  in  Fig.  22 

is  obtained  in  the  same  way  as  for  machine  A  by  adding  a  nonzero  carry 

to  the  first  bit-position  of  the  section  on  the  left-hand  side.  The 

state  graph  of  machine  A*  as  shown  in  Fig.  23  is  found  by  modifying  that 

of  machine  A  as  follows:  When  machine  A’  reaches  the  state  s^  or  s^ 

during  the  last  digit  transformation  for  the  section  on  the  right-hand 

side,  the  next  input-output  pair  becomes  #/(e, 0^)  where  9^  is  a  control 

signal  [37],  which  activates  a  logic  circuit  to  select  machine  A  in  the 

section  on  the  left-hand  side.  On  the  other  hand,  when  machine  A' 

reaches  the  state  si  or  si,  the  next  input-output  pair  becomes #/(e,0„) , 

J  4  o 

where  9^  is  the  control  signal  to  select  machine  B.  Thus,  the  addition 
speed  is  almost  doubled  when  the  n  summand  digit-pairs  are  grouped  into 
two  sections.  It  is  noted  that  the  speed  can  be  increased  further  if 
more  sections  are  used.  However,  no  matter  how  many  sections  the  n  sum¬ 
mand  digit-pairs  are  grouped,  every  section,  except  the  extremely  right 
one  and  the  extremely  left  one,  consists  of  machines  A*  and  B’,  where 
machine  B'  is  obtained  by  adding  the  output  control  signals  6^  and  9^  to 
the  appropriate  state  transitions  of  machine  B.  The  extreme  right  sec¬ 
tion  has  machine  A’  only,  and  the  extreme  left  section  consists  of 
machines  A  and  B.  Although  this  method  of  state  transitions  of  increas¬ 
ing  the  addition  speed  is  similar  to  that  of  the  conditional  sum  adder 
proposed  by  Sklansky  [38],  yet  the  rate  of  increase  of  hardware  in  our 
system  is  much  smaller. 
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6.  DISCUSSION 

For  all  cryogenic  associative  memory  systems,  the  speed  appears  to 
be  the  main  problem  because  the  operations  of  cryotron  circuits  are  re¬ 
latively  slower  than  that  of  magnetic  cores,  cutpoint  cells  and  some  other 
devices.  In  our  cryogenic  associative  memory  system,  we  have  attempted  to 
increase  the  operating  speed  in  various  aspects.  For  example,  each  matched 
word  *  <<ni<»/>ted  by  only  a  pair  of  cryotrons  and  Q^,  and  consequently 

there  is  only  one  stage  of  delay  caused  by  the  switching  time  of  and 

between  the  end  of  comparison  process  and  the  subsequent  process  such 
as  reading,  writing,  etc.  The  match-indication  voltage  V__  is  used  as  the 
signal  for  automatic  termination  of  sequential  writing  process  or  non-ordered 
information  retrieval.  Excessive  empty  words  can  be  deraatched  by  the  current 
pulse  Ip  as  soon  as  all  data  words  are  stored  in  the  memory.  Thus  unnecessary 
delays  in  these  operations  are  eliminated. 

In  the  cutpoint  cellular  associative  memory  system,  the  delay  of  the 
tree-type  circuit  can  be  reduced  if  we  use  OR-gates  with  more  inputs  instead 
of  using  cutpoint  cells.  It  is  noted  that  the  stage  delay  T^  of  a  cutpoint 
cell  with  index  k  is  assumed  to  be  different  for  various  values  of  k.  Be¬ 
cause  these  cells  are  identical  in  structures  with  only  different  cutpoint, 
their  stage  delays  may  be  compensated  so  that  they  are  all  the  same.  Then, 
the  hardware  design  based  on  stage  delay  analysis  is  much  simplified. 

In  pattern  recognition,  the  capability  of  our  scheme  largely  depends  on 
the  determination  of  the  templates  for  pattern  classes,  further  research  is 
required  to  establish  a  method  in  finding  a  set  of  templates,  which  allows 
large  deviations  of  each  pattern  class  and  reduces  the  number  of  mis-classi- 
fication.  Another  direction  of  research  in  this  area  is  to  extend  this  re¬ 
cognition  scheme  from  classifying  noisy  patterns  based  on  the  concept  that 
aij=  ^(black)  if  the  lightest  figure  element  in  a^  of  the  input  pattern  is 
darker  than  the  darkest  part  of  the  background  and  a^=  l(white)  if  other¬ 
wise.  In  this  case,  the  darkest  part  of  the  background  in  the  input  pattern 
constitutes  a  threshold  value  and  consequently  a  test  is  required  when  the 
input  pattern  is  transformed  to  an  initial  interrogating  word  for  the  first 
comparison  process. 
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Some  of  the  technical  terms  used  in  chapter  2  are  defined  as  follows: 
An  empty  memory  word  or  simply  empty  word  is  a  word  with  all  of  its  bit- 
memories  containing  zero  persistent  current.  An  occupied  memory  word  or 
simply  occupied  word  means  a  word  with  at  least  one  of  its  bit-memories 
containing  the  information  bit  "0"  or  "1"  represented  respectively  by  the 
nonzero  clockwise  or  counterclockwise  persistent  current  circulating  in 
the  memory  loop. 

An  interrogating  word  is  a  sequence  of  n  bits  consisting  of  the  ele¬ 
ments  in  the  set  {  O,l,e,0},  where  n  is  the  total  number  of  bits  per  word, 
and  e  and  0  represent  the  ’’empty"  and  "don’t-care"  respectively.  It  is 
used  for  simultaneous  comparison  with  all  the  memory  words,  which  are  call¬ 
ed  the  interrogated  words.  The  interrogating  bits  are  defined  in  Table  1. 

A  matched  word  is  an  interrogated  word  which  is  matched  with  the  in¬ 
terrogating  word.  A  mismatched  word  is  the  interrogated  word  which  is  not 
matched  with  the  interrogating  word.  The  first  matched  word  means  a  matched 
word  which  occupies  the  word-position  numbered  with  the  smallest  number 
among  all  the  matched  words. 

Ordered  retrieval  of  information  is  a  retrieving  scheme  which  reads 
out  the  desired  words  sequentially  in  an  ascending  (or  descending)  order 
of  the  magnitudes  of  their  binary  equivalent  values;  whereas  non-ordered 
retrieval  of  information  is  a  retrieving  scheme  which  reads  out  the  de¬ 
sired  words  sequentially  according  to  the  order  of  their  word  locations 
in  the  memory  system  rather  than  the  magnitudes  of  their  binary  equivalent 


values. 

The  Identifier  of  a  word  is  the  portion  of  the  word-content  which  is 
used  for  the  comparison  process  during  the  retrieval  of  that  word  from  a 
memory  system,  and  the  remaining  portion  of  the  word  is  called  the  don't- 
care  part,  which  is  to  be  masked  out  during  the  comparison  process.  The 
descri ptor  of  a  set  A  of  words  is  a  bit-position,  which  has  the  same  con¬ 
tent  for  all  the  words  in  A. 
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APPENDIX  II 


Derivation  of  the  Stage  Delay 

Referring  to  Fig,  12,  the  stage  delay  T  between  the  leading  edge 
/i)  ysi. 

of  Y^  and  the  pulse  'is  found  to  be 

T  =  T  +  T  -  T  (II. 1) 

ysl  yb  lkj  sil* 

where  T  ^  and  T^^  are  given  by  (28)  and (31)  respectively.  The  stage 

delay  T  between  the  leading  edges  of  the  control  current  I  and  I 
IK-  1  K 

is  the  sum  of  the  following  three  terms:  The  fir  t  term  is  (k^-2)  (T^+T,.) 
which  is  the  stage  delay  between  the  leading  edges  of  I.  and  I  ..  The 

(1)  ^  l”* 

second  term  is  (T  +T  )  which  is  the  stage  delay  between  the  leading 
1  s  (1) 

edge  of  I  .  and  the  shift  pulse  H  ^  ,  and  the  third  term  is 

Rl’1  (11 

(T^+2T,.+T^)  between  the  pulse  ^  and  the  leading  edge  of  1^  . 

Therefore,  T  is  given  by  the  equation 
lkl 


Tikl-  h  W  llWi“ 

Substituting  (28),  (31)  and  (II. 2)  into  (II. 1),  we  obtain 

V  VW'Y  2+  [lcV]  >  V'X” 

In  order  to  include  the  possibility  that  the  first  matched  word  is  the 
last  memory  word  m,  we  have  to  set 

Ts0"  <"-V  V 

The  stage  delay  T  .  which  is  given  by  (30)  yields  when  (II. 4)  is 
ysi 

substituted  in  (II. 3). 

Derivation  of  the  Stage  Delay  T 


(II. 2) 


(II  .3) 


(II .4) 


Similar  to  the  above  method,  the  stage  delay  T  between  the  leading 

(1)  yx 

edges  of  and  is  found  to  be 

T  =  T  ,+  T  ,_+T.  +T(1).  (II. 5) 

yx  ysl  sil  iw  w 

Substituting  (30),  (31)  and  (32)  into  (II. 5),  we  have 


V  WV(”-1+  l1^"]  >  V  klT5+V2Tn+T2.5+T„  • 


i1K  <"-Y  T5 


(II.  6) 


(II. 7) 


e 


We  have  to  set 
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in  order  to  include  the  possibility  of  the  first  matched  word  being  at 

the  position  m.  The  stage  delay  T  which  is  given  by  (33)  yields  when 

(II. 7)  is  substituted  into  (11,6). 

Derivation  of  the  Time  Interval  T  or  T 
_ ss _ XX 

It  follows  from  Fig.  12  that  the  time  interval  T^^  between  the 

(1)  (2)  .  SS 

shift  pulses  and  is  given  by  the  equation 


T^I)_t  +T  +  T^^+  T  +T  -T 

ss  sil  iw  w  xb  b,k^  ^  si2” 


(II. 8) 


where  T  ...  T.  and  T  ,  are  given  by  (31),  (32)  and  (34)  respectively, 
sil  lv?  xb 

The  stage  delay  T  between  the  trailing  edge  of  1L.  and  the  leading 

b , k  _ 

edge  of  I,  .  is  the’sum  of  the  following  three  terms:  The  first  term 

(2)  kl+k? 

is  Tv  1  which  is  the  possible  delay  between  the  trailing  edge  of  R., 

s  (2)  (2)  Ukl 

and  the  shift  pulse  ^  initiated  by  ,  the  second  term  is  k^T,. 

1  (2)  (2) 

which  is  the  delay  between  the  pulses  H,  and  ^  and  the  third 
term  is  (T^+2T,.-rT1  ^)  which  is  the  delay  between  the  sfiift  pulse  ^ 


and  the  leading  edge  of  I,  ,,  Thus,  T  .  is  given  by  the  equation 

Ki  K2*  D,K1,2 

(2) 

Tb  k  "  T4+(k2+  2)  V  T13+  s  • 

1 » 2 

It  follows  from  (31)  that  the  stage  delay  T  between  the  shift  pulse 

(2) 

and  the  leading  edge  of  is  found  to  be 

Tsi2=  V(kl+  V  T5+  T13* 

Substituting  (31),  (32),  (34),  (II. 9)  and  (II .10)  into  (II. 8)  we  have 

=  V  V  0  +  [loE2n]  >  V  3V  V  3T13+ 


(II. 9) 


(II.  10) 


T  +  T  +  t(2)+  T(l) 

3,4  2,5  s  w 


(II. ID 


,(5+1) 


The  time  interval  T'^  between  the  shift  pulses  H.  and  H.  can  be 

ss  1  1 

obtained  by  modifying  (II. 11).  It  is  given  by  the  equation 
T,+  T3+  (1  +  [loE2n]  )  V  3T5+  Tf  31^+ 

T,  ,+  T  +T(g+1)+T(B).  < 

3,4  2,5  s  w 

To  allow  the  possibility  that  the  last  tagged  word  k^+k^.-.+k^  occurs 

at  the  last  memory  word  m,  we  set 

k,4k  +  . . . .+k  =  m.  * 

1  2  r 


(11.12) 


(11.13) 


ii  i  t  in  rmiiiii'iMi  i  >>■  iiii hi  i  iitKfri 


Moreover,  the  stage  delay  between  the  shift  pulse  and  the 

writing  pulse  X^g  is  given  by  the  equation 


T(g)=  T.  +  Clk.)  T  +  2T  +  T  +  T(g). 
sx  4  j-1  j  5  13  2,5  w 


(11.14) 


which  is  obtained  from  Fig.  12,  (31)  and  (32).  Because  we  intend  to  keep 


(11.16) 


the  time  intervals  T'  ,  to  be  the  same  for  g=l,2,...,r,  we  have 

SX 

T(g)  =  (m  -  J.k.)  T  ,  (11.15) 

w  J=1  J  5 

which  is  obtained  from  (11.7),  (11.13)  and  (11.14).  If  we  set 

T(b+1).  <1  k.)  T  ,  g  S  1  (O.lf 

s  j-1  J  5 

and  substitute  (11.15)  and  (11.16)  into  (11.12),  we  obtain 

T  “  Tl+  T3+  ^  +  Ll0S2rl  ^  T4+  ^  +  T5+  T6+ 

3T  +  T  +  T  .  (II.  li 

J  13+  3,4+  2,5’ 

in  which  we  have  dropped  the  superscript  (g)  because  (11.17)  is  independent 
vf  the  position  of  the  tagged  word.  It  is  noted  that  (11.17)  is  exactly 
the  same  as  (35),  which  we  want  to  derive. 


(11.17) 
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ABSTRACT  (continued) 

shift  registers  and  Mealy  type  sequential  machines.  This  system  may  have 
the  advantage  of  reducing  addition  time  by  paying  a  limited  price  in  the 
additional  hardware  relative  to  the  existing  software  approaches  for 
arithmetic  algorithms . 
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